$y*lenks & Cmiral: Fwiuclmiimi A Appljc^ikins 


A lain liensoussan 
Giuseppe Da Prato 
Michel C * Detfuur 
Sanjoy K. Mitter 


Representation and Control 
of Infinite Dimensional 

Systems 

Second Edition 


Inf Fk[r| i\T\ - l* Qd •£ i Hi i >« 
TJ>: J+ 

iT* A* ■■ -T« * . f In Tl= ii (*3 - Aa 


r +■ rA 4 A m p - r ji fr' srr - o ■ »in (a-n 
pitt -r 



Birkhauser 














Systems & Control: Foundations & Applications 


Series Editor 

Tamer Ba§ar, University of Illinois at Urbana-Champaign 


Editorial Board 

Karl Johan Astrom, Lund University of Technology, Lund, Sweden 
Han-Fu Chen, Academia Sinica, Beijing 
William Helton, University of California, San Diego 
Alberto Isidori, University of Rome (Italy) and 
Washington University, St. Louis 
Petar V. Kokotovic, University of California, Santa Barbara 
Alexander Kurzhanski, Russian Academy of Sciences, Moscow 
and University of California, Berkeley 
H. Vincent Poor, Princeton University 
Mete Soner, Ko<j University, Istanbul 



Alain Bensoussan 
Giuseppe Da Prato 
Michel C. Delfour 
Sanjoy K. Mitter 


Representation and Control of 
Infinite Dimensional Systems 

Second Edition 


Birkhauser 

Boston • Basel • Berlin 



Alain Bensoussan 
School of Management 
University of Texas at Dallas 
Office 3.211 

Richardson, TX 75083-0688 
USA 


Michel C. Delfour 

Centre de recherches mathematiques 

and 

Departement de mathematiques et de statistique 
Universite de Montreal 
C.R 6128, succ. Centre-ville 
Montreal (QC), Canada H3C 3J7 


Giuseppe Da Prato 
Scuola Normale Superiore 
Palazzo della Carovana 
Piano 3, studio 56 
Pisa 56126 
Italy 


Sanjoy K. Mitter 

Department of Electrical Engineering 
and Computer Science 
Laboratory for Information and 
Decision Systems 

Massachusetts Institute of Technology 
77 Massachusetts Avenue 
Cambridge, MA 02139 
USA 


Mathematics Subject Classification: 34H05, 47D03, 47N70, 49-02, 49J27, 49K27, 93C25, 93C95 

Library of Congress Control Number: 2006936851 

ISBN-10: 0-8176-4461-X e-ISBN-10: 0-8176-4581-0 

ISBN-13: 978-0-8176-4461-1 e-ISBN-13: 978-0-8176-4581-6 

Printed on acid-free paper. 

©2007 Birkhauser Boston BirklldUSer 

All rights reserved. This work may not be translated or copied in whole or in part without the writ¬ 
ten permission of the publisher (Birkhauser Boston, c/o Springer Science+Business Media LLC, 233 
Spring Street, New York, NY 10013, USA), except for brief excerpts in connection with reviews or 
scholarly analysis. Use in connection with any form of information storage and retrieval, electronic 
adaptation, computer software, or by similar or dissimilar methodology now known or hereafter de¬ 
veloped is forbidden. 

The use in this publication of trade names, trademarks, service marks and similar terms, even if they 
are not identified as such, is not to be taken as an expression of opinion as to whether or not they are 
subject to proprietary rights. 

987654321 



www. birkhauser. com 


(SB) 


In memory of Andree 




Preface to the Second Edition 


A new edition in a single volume 

Over the past decade, more and more sophisticaced mathematical tools and 
approaches have been incorporated in the field of Control of infinite dimen¬ 
sional systems. This was motivated by a whole range of challenging applica¬ 
tions arising from new phenomenological studies, technological developments, 
and more stringent design requirements. At the same time, researchers and 
advanced engineers have been steadily using an impressive amount of very 
sophisticated mathematics in their analysis, synthesis, and design of systems. 
What was regarded as too abstract, specialized, or theoretical in 1990 has now 
become a standard part of the toolkit. 

The decision to produce a second edition of the original 1992-1993 two- 
volume edition is further motivated by several other factors. Over the years 
the book has been recognized as a key reference in the field, and a revised and 
corrected edition was desirable. Even if some good books on the control of 
infinite dimensional linear systems have appeared since then, we felt that the 
original material has not aged too much and that the breadth of its presenta¬ 
tion is still attractive and very competitive. The result is a completely revised 
and corrected second edition in a single convenient volume with integrated 
bibliography and index. 

The book has been restructured into five parts and each part into several 
chapters. The most significant changes occurred in Part I, which now provides 
a very broad account of finite dimensional linear systems. It serves as a back¬ 
ground and a motivation for the other parts. The scope of this part has been 
expanded by adding topics such as dissipative systems in Chapter 1 and intro¬ 
ducing a new Chapter 2 on linear quadratic two-person zero-sum differential 
games that provides an example of a solution to the matrix Riccati differential 
equation that is not necessarily positive semi-definite and some connections 
with the H °°-theory and dissipative systems of Chapter 1. 
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Description of the five parts 

Part I on the control of finite dimensional linear dynamical systems and linear 
quadratic two-person zero-sum differential games presents a broad review of 
the field. It is an introduction and a motivation for the book, so that the reader 
understands the background from which the infinite dimensional theory is 
developed and also obtains an appreciation of the substantial conceptual and 
technical difficulties that had to be overcome to give a satisfactory treatment 
of the subject in the infinite dimensional context. Chapter 1 is concerned with 
the theory of controllability and observability of linear systems, and the role 
these concepts play in the study of the quadratic cost problem over an infinite 
time horizon. It has been expanded to include, in addition to the updated 
section on the U°°-theory, a new section on the theory of dissipative systems 
of J. C. Willems [2], 

A new Chapter 2 on linear quadratic two-person zero-sum differential 
games has been included to broaden the perspective. The pioneering work 
in that area has been done in the paper of P. Bernhard [2] in 1979 and 
the seminal book of T. Ba§AR and P. Bernhard [1] in 1991 and 1995. This 
chapter is self-contained with complete mathematical proofs. It focuses on the 
open loop case. New results using the invariant embedding approach of R. Bell¬ 
man in the style of J. L. Lions [3] are included to provide further insight into 
the associated inf sup (open loop upper value) and sup inf (open loop lower 
value) problems. This is combined with developments by P. Zhang [1] in 2005 
who established that in the linear quadratic case the duality gap is either zero 
or infinite. This means that only three cases can occur: (a) sup inf= — oo and 
inf sup finite; (b) sup inf finite and inf sup = + 00 ; and (c) sup inf and inf 
sup both finite; in which case, there is equality and the existence of a saddle 
point. In particular it illustrates the occurrence of symmetrical solutions to 
the matrix Riccati differential equation that are not necessarily positive semi- 
definite. It also connects with the glimpse of H °°-theory and the new section 
on the theory of dissipative systems at the end of Chapter 1. 

Part II deals with the representation of infinite dimensional systems. It 
develops semigroup theory and variational methods for the representation of 
infinite dimensional systems such as dynamical partial differential equations 
and delay differential systems. Chapter 1 gives a unique presentation of the 
theory of semigroups of linear operators integrated with interpolation theory. 
It brings together advanced concepts and techniques that are usually treated 
independently. Chapter 2 provides a basic introduction to the variational the¬ 
ory of parabolic systems. It nicely describes the explicit and illuminating con¬ 
nection between the early work of T. Kato and J.-L. Lions and the later results 
of P. Auscher, S. Hofmann, J. L. Lewis, and Ph. Tchamitchian [1] in 
2001 on the Kato’s conjecture on the domain of the square root operators. 
Chapter 3 contains the basic constructions to effectively deal with unbounded 
control and observation operators via semigroup methods. 
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IX 


Chapter 4 on the modeling of differential systems with delays in the state, 
control, and observation is self-contained. To our knowledge, it is possibly 
the only book where the state space theory is completely developed using 
the fundamental structural operators introduced by Delfour and Manitius in 
1976-1977 and further extended to the neutral case by M. C. Delfour and 
J. Karrakchou [1,2] in 1987. 

Part III is devoted to the generic qualitative properties of controlled sys¬ 
tems. It studies the controllability for an infinite dimensional abstract linear 
dynamical system , which can be specialized to obtain results for controllability 
of parabolic and hyperbolic partial differential equations both when control is 
exercised in the interior of the domain and when control is exercised through 
the boundary. The important problem of exact controllability of hyperbolic 
equations in appropriate spaces, which leads to stabilizability properties for 
these systems (and hence verification of the finite cost condition for infinite 
time problems) is discussed in detail in this chapter. The systematic use of 
eigenvalues and eigenfunctions of appropriate differential operators to obtain 
the results is a somewhat novel aspect of this chapter. 

Parts IV and V present a dynamical programming approach to the optimal 
linear quadratic control problem over a finite and an infinite time horizon of 
certain classes of infinite dimensional systems. Dynamic programming is a 
deep conceptual idea. Its applications are manifold. For the philosophically 
minded reader, we have provided a quotation from Soren Kierkegaard on 
page xvi of the Preface to Volume II of the First Edition as an indication that 
philosophy might often anticipate developments in science. 

Part IV is devoted to the quadratic cost optimal control problem over a 
finite time horizon. We develop the theory for an abstract dynamical model 
satisfying certain semigroup (group) assumptions, and then we treat concrete 
situations by verifying these assumptions using differential equations (partial, 
functional-differential) methods. This chapter presents a reasonably complete 
treatment of the subject, which includes both boundary control and bound¬ 
ary observation (not necessarily simultaneously) for parabolic and hyperbolic 
systems. Technically, these are the more difficult parts of the book because 
they involve unbounded control and observation operators. Many of the re¬ 
sults presented here appeared in book form for the first time in 1993. The 
approach we adopt is dynamic programming , which leads to a synthesis of the 
optimal control in feedback form via a study of an operator Riccati differential 
equation. The systematic use of dynamic programming gives a unified view of 
this topic. 

Part V, the final part of the book, is concerned with the quadratic cost 
optimal control problem over an infinite time horizon. Here the concepts of 
stabilizability and detectability play an essential role. The properties of stabi¬ 
lizability and detectability have to be verified, in some sense directly, for the 
parabolic case (which has a finite dimensional unstable part) and via the the¬ 
ory of exact controllability (for example) in the hyperbolic case. Thus, there is 
a close relation between Part V and Parts I and III of the book. The approach 
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here is again via dynamic programming and a study of an algebraic matrix 
Riccati equation. We also prove the stability of the closed loop system. In 
many (but not all) situations, the theory of the infinite time quadratic cost 
problem in the infinite dimensional case is as complete as for the finite dimen¬ 
sional situation. Again, many results here appeared for the first time in book 
form in 1993. 
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At the end of the 1960s, the state space theory of linear systems both for time- 
invariant and time-varying systems had essentially been worked out. The basic 
concepts of controllability, observability, and their relationship to the theory 
of minimal realizations received almost a complete treatment in the work 
of Kalman and others. The feedback solution of the quadratic cost optimal 
control problem, both in a finite and an infinite time interval were well under¬ 
stood. The concepts of controllability and observability and the weaker no¬ 
tions of stabilizability and detectability play an essential role through stability 
ideas in the solution of the infinite time quadratic cost optimal control prob¬ 
lem. The ideas of optimal control from the Hamilton- Jacobi-Caratheodory, 
dynamic programming, calculus of variations (and in its modern form the 
McShane-Pontryagin maximum principle) points of view had received defin¬ 
itive treatments. As far as deterministic control problems for finite dimen¬ 
sional linear systems are concerned, attention shifted away from optimality 
to synthesis problems, such as decoupling, regulator, and tracking with inter¬ 
nal stability, and to a unification of the time and frequency domain points of 
view. A qualitative theory of nonlinear control of finite dimensional dynamical 
systems began its development at the same time. 

It is a fact that most lumped parameter systems are approximations of 
distributed parameter systems, and hence, the study of infinite dimensional 
systems such as control of systems governed by partial differential equations 
and functional differential equations are both of intrinsic interest and poten¬ 
tially important for application areas such as chemical process control, control 
of elastic structures, and even for challenging issues such as the stabilization of 
plasma instabilities. It was, in some sense, natural to concentrate on optimal 
control problems for infinite dimensional systems so that the well-developed 
theory of calculus of variations and Hamilton-Jacobi theory could be suit¬ 
ably generalized and used. Clearly the first step in such a development is a 
reasonably complete understanding of the linear quadratic problem both over 
a finite and an infinite time interval. This book attempts to do this with a 
reasonable degree of completeness. 
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xii 


This book has been many years in the making, and the original technical 
reports date back to 1975. It must also be one of the most cited books with 
the appended words “to appear.” The reasons for this delay in publication 
are complex and could be the subject of psycho-analytical research or a study 
into the origins of human frailties. It started out as a collaborative effort of 
Alain Bensoussan, Michel C. Delfour, and Sanjoy Mitter. From the outset 
it was our intention to write a book that would go beyond what was then 
available in the literature of optimal control of infinite dimensional systems 
and cover such topics as the feedback boundary control of hyperbolic systems 
when control is exercised through Dirichlet boundary conditions, feedback 
control of hyperbolic systems over an infinite time interval, and the control of 
neutral functional differential equations. In retrospect, we seriously underes¬ 
timated the difficulty of carrying out such a program. Indeed the solution of 
many of these control problems required results that were then not available 
in the partial differential equations literature. For example, the solution of 
certain problems of optimal control of hyperbolic equations with a quadratic 
cost but over an infinite time interval required a result that would enable one 
to conclude that the set of admissible controls is nonempty. Such a result is 
a byproduct of the theory of exact controllability of hyperbolic systems, a 
theory that was only developed in the 1980s. Our research interests had also 
changed in the mid-1970s, and although we continued to think about the sub¬ 
ject matter of this book, we did not return to it seriously until the mid-1980s 
or so. Even then the book would never have been completed but for the efforts 
of Giuseppe Da Prato who joined the team approximately two years ago (one 
of the coauthors takes full credit for having had the brilliant idea of enlisting 
Da Prato in the project). The result is a book by four authors, from four 
different countries, who met in Pisa, Paris, Montreal, and Cambridge, Mass, 
to bring this long endeavor to completion—surely a model of international 
cooperation. Readers of the book will have to judge whether this effort has 
been successful. 

Earlier versions of some chapters of this book have been used for graduate 
courses at the Scuola Normale Superiore (Chapter 1) and at the Universite 
de Montreal (Chapters 1 and 4). Other parts have been used for graduate 
seminars. 

It is a pleasant task to thank the many institutions that have made this 
work possible—Universite de Paris- Dauphine and INRIA, France; Scuola 
Normale Superiore, Pisa, Italy; Centre de recherches mathematiques and 
Departement de mathematiques et de statistique, Universite de Montreal, 
Canada; Department of Electrical Engineering and Computer Science and the 
Laboratory for Information and Decision Systems, Massachusetts Institute of 
Technology, Cambridge, MA, USA. The research of Giuseppe Da Prato has 
been partially supported by the Italian National Project MURST “Equazioni 
di Evoluzione e Applicazioni Fisico-Matematiche.” The research of Michel 
C. Delfour has been supported by the Natural Sciences and Engineering Coun¬ 
cil operating grant OGP-8730 and infrastructure grant INF-7939, the “Min- 
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over a long period, and the U.S. Army Research Office through the Center for 
Intelligent Control Systems for the last six years. This support is gratefully 
acknowledged. 
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ing, and Margaret Flaherty of the Laboratory for Information and Decision 
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Volume I of this two-volume book has dealt with the question of modeling and 
representation of infinite dimensional systems. Volume II is concerned with 
the optimal control of certain classes of infinite dimensional systems with a 
quadratic cost criterion, both over a finite and an infinite time horizon. The 
knowledge of Volume I is a prerequisite for reading Volume II. 

Volume II consists of three parts. Chapter 1 of Part I is concerned with 
the theory of controllability and observability of finite dimensional linear sys¬ 
tems, and the role these concepts play in the study of the quadratic cost 
problem over an infinite time horizon. This chapter is included so that the 
reader understands the background from which the infinite dimensional the¬ 
ory developed and obtains an appreciation of the substantial conceptual and 
technical difficulties that had to be overcome to give a satisfactory treatment 
of the subject in the infinite dimensional context. Chapter 2 is devoted to the 
study of controllability for an infinite dimensional abstract linear dynamical 
system that can be specialized to obtain results for controllability of parabolic 
and hyperbolic partial differential equations both when control is exercised in 
the interior of the domain and when control is exercised through the bound¬ 
ary. The important problem of exact controllability of hyperbolic equations in 
appropriate spaces, which leads to stabilizability properties for these systems 
(and hence verification of the “finite cost” condition for infinite time prob¬ 
lems), is discussed in detail in this chapter. The systematic use of eigenvalues 
and eigenfunctions of appropriate differential operators to obtain the results 
is a somewhat novel aspect of this chapter. 

Part II of the book is devoted to the quadratic cost optimal control problem 
over a finite time horizon. We develop the theory for an abstract dynamical 
model satisfying certain semigroup (group) assumptions, and then we treat 
concrete situations by verifying these assumptions using differential equations 
(partial, functional-differential) methods. This chapter presents a reasonably 
complete treatment of the subject, which includes both boundary control and 
boundary observation (not necessarily simultaneously) for parabolic and hy¬ 
perbolic systems. Technically, these are the more difficult parts of the book 
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because they involve unbounded control and observation operators. Many of 
the results presented here appear in book form for the first time. 

The approach we adopt is dynamic programming, which leads to a synthesis 
of the optimal control in feedback form via a study of an operator Riccati 
differential equation. The systematic use of dynamic programming gives a 
unified view of this topic. 

Part III, the final part of the book, is concerned with the quadratic cost 
optimal control problem over a infinite time horizon. Here the concepts of 
stabilizability and detectability play an essential role. The properties of stabi- 
lizability and detectability have to be verified, in some sense directly, for the 
parabolic case (which has a finite dimensional unstable part) and via the the¬ 
ory of exact controllability (for example) in the hyperbolic case. Thus, there 
is a close relation between Parts I and III of the book. The approach here is 
again via dynamic programming and a study of an algebraic Riccati equation. 
We also prove the stability of the closed loop system. In many (but not all) 
situations the theory of the infinite time quadratic cost problem in the infinite 
dimensional case is as complete as for the finite dimensional situation. Again, 
many results here appear for the first time in book form. 

Dynamic programming is a deep conceptual idea. Its applications are man¬ 
ifold. For the philosophically minded reader, we have provided the following 
quotation from Soren Kierkegaard as an indication that philosophy might 
often anticipate developments in science: 

It is perfectly true, as philosophers say, that life must be understood 
backwards. But they forget the other proposition, that it must be lived 
forwards ... And if one thinks over the proposition it becomes more 
and more evident that life can never really be understood in time sim¬ 
ply because at no particular moment can I find the necessary resting- 
place from which to understand it-backwards. 

From entry in Soren Kierkegaard’s Journal for the Year 1843. 

Quoted in Richard Wollheim, Thread of life. 

Harvard University Press, Cambridge, MA, 1984. 

Earlier versions of some chapters of this book have been used for graduate 
courses at the Scuola Normale Superiore and at the Universite de Montreal. 
Other parts have been used for graduate seminars. 

It is a pleasant task to thank the many institutions that have made this 
work possible—Universite de Paris- Dauphine and INRIA, France; Scuola 
Normale Superiore, Pisa, Italy; Centre de recherches mathematiques and 
Departement de mathematiques et de statistique, Universite de Montreal, 
Canada; Department of Electrical Engineering and Computer Science and the 
Laboratory for Information and Decision Systems, Massachusetts Institute of 
Technology, Cambridge, MA, USA. The research of Giuseppe Da Prato has 
been partially supported by the Italian National Project MURST “Equazioni 
di Evoluzione e Applicazioni Fisico-Matematiche.” The research of Michel 
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C. Delfour has been supported by the Natural Sciences and Engineering Coun¬ 
cil operating grant OGP-8730 and infrastructure grant INF-7939, the “Min- 
istere de l'Education du Quebec” through a FCAR Team Grant, the France- 
Quebec exchange program, and a Killam Fellowship from Canada Council. 
The research of Sanjoy Mitter has been supported by the U.S. National Sci¬ 
ence Foundation in the 1970s, the U.S. Air Force Office of Scientific Research 
over a long period, and the U.S. Army Research Office through the Center for 
Intelligent Control Systems for the last six years. This support is gratefully 
acknowledged. 

It is a pleasure to thank Georg Schmidt for a critical reading of Part I, 
Chapter 2 of the book. His comments have led to many improvements in this 
chapter. We thank Edwin Beschler of Birkhauser Boston Inc. for his coopera¬ 
tion, Ann Kostant also of Birkhauser for expert help in word processing, and 
Margaret Flaherty of the Laboratory for Information and Decision Systems 
(M.I.T.) for typing large parts of the manuscript with precision and care. 
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Introduction 


1 Scope of the book 

The primary concern of this book 1 is the control of linear infinite dimensional 
systems, that is, systems whose state space is infinite dimensional and its 
evolution is typically described by a linear partial differential equation, linear 
functional differential equation or linear integral equation. 

We focus on two aspects of the control problem: 

(i) qualitative properties such as stability, controllability, and observability; 

(ii) optimal feedback control of such systems when the performance is mea¬ 
sured by a quadratic cost criterion, both over a finite and an infinite time 
interval. 

However, before such a study can be carried out, a detailed investigation 
of the problem of representation of infinite dimensional systems is needed. 
This is done in Part II of the book, and Parts III to V are devoted to a study 
of the control problem. This endeavor is initiated by a broad review of finite 
dimensional systems in Part I so that the reader understands the background 
from which the infinite dimensional theory is developed and also obtains an 

1 The numbering of equations, theorems, propositions, lemmas, corollaries, defi¬ 
nitions, examples, notations, and remarks is by chapter. When a reference to 
another chapter within a part is necessary, it is always followed by the words in 
Chapter and the number of the chapter : for instance “in equation (2.1) of Chap¬ 
ter 3”. When a reference to another chapter in a different part is necessary, it is 
always followed by the words of Chapter, the number of the chapter, of Part, and 
the number of the part: for instance “equation (2.1) in Chapter 1 of Part IV”. 
The text of theorems, propositions, lemmas, and corollaries is slanted; the text of 
definitions, examples, notations, and remarks is normal shape ended by a square 
□ . The bibliography is by author in alphabetical order. For each author or group 
of coauthors, there is a numbering in square brackets starting with one. A refer¬ 
ence to an item by a single author is of the form J. L. Lions [4], and a reference 
to an item with several coauthors R. Bellman and K. L. Cooke [1]. 
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appreciation of the substantial conceptual and technical difficulties that had 
to be overcome to give a satisfactory treatment of the subject in the infinite 
dimensional context. 


2 From finite to infinite dimensional sytems 


It is the purpose of this introductory chapter to give an idea of the problematic 
and explain the reason for the necessary mathematical development in func¬ 
tional analysis and differential equations that is carried out in this book. In 
the process we provide both a qualitative summary of the differences between 
finite dimensional systems and infinite dimensional systems as well as provide 
a detailed outline of the book. It should be mentioned that technological prob¬ 
lems of importance such as the control of large-space structures, analysis and 
control of plasma fusion, and chemical process control where significant time 
delays are present need an understanding of the theory presented in this book 
for their rigorous analysis. We do not present the frequency domain point of 
view in this book. If finite dimensional theory is any guide, then the engineer¬ 
ing solution of technological problems will undoubtedly require a synthesis of 
the time and frequency domain viewpoints. 

To get an appreciation of the technical problems associated with the con¬ 
trol of infinite dimensional systems, consider the distributed control of wave 
motion. Let y{x, t) denote the transverse displacement at time t > 0 of a 
vibrating medium in an n-dimensional bounded open region O with smooth 
boundary 90 C R”. Let us assume that 

y(x , t) = 0 for x G 90 and t > 0 


and let the initial data at time t = 0 be 

9 

y(x , 0) = y 0 and — y{x , 0) = y u 
ot 

for some sufficiently smooth functions yo and y\ defined on 0. Consider the 
partial differential equation 


^■(t) + Ay(t) = Bu(t) 


( 2 . 1 ) 


or the equivalent first-order system 


||(t) - z(t) = 0, 
dz 

-g^(t) + Ay(t) = Bu(t), 


( 2 . 2 ) 


where the operator 
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A = - 



ag(x), a q(x) > a > 0 


is a uniformly elliptic operator with C °°-coefficients in O, that is, (ijj G 
C°°(Sl). 2 Let the controllers u(-) G L 2 (0, oo; K m ) and let 


B(x )“=* [B 1 (x)---B rn (x)] 


be an n x m matrix with each column in C°° (SI) . We consider the state space 

2 Let SI be an open subset of R”. Denote by C(fl) or C°(fl) the space of continuous 
functions from SI to R, and for an integer k > 1, 

C k (Q) d = {/ G C k ~\S 1) : 0 a f G C(n), Va, |aj = fc} , 


where a = (qi, ..., qjv) G is a multi-index, |a| = Qi + • • • + ajv is the order 
of the derivative, and 


r\o: p def 

9 f = 


d \Af 


dx ... dx% N 


(2.3) 


By convention d°f will be the function / in order to make sense of the case a = 0. 
When |a| = 1, we also use the standard notation dif or df/dxi. V k (Q) or C k (Q.) 
(resp., V(yi) or C)? 0 (fl)) will denote the space of all fc-times (resp., infinitely) 
continuously differentiable functions with compact support contained in the open 
set Q. 

A function / : —» R is uniformly continuous if, for each e > 0, there exists 

5 > 0 such that for all x and y in D such that \x — y\ <8 we have \f(x) — f(y)\ < e. 

If a function / is bounded and uniformly continuous on fi, it possesses a unique, 
continuous extension to the closure of fi. Denote by C k (Q) the space of functions 
/ in C k (Q.) for which d a f is bounded and uniformly continuous on for all a, 
0 < M < k. A function / in C k (£l) is said to vanish at the boundary of f l if for 
every a, 0 < |a| < k, and e > 0, there exists a compact subset K of Q such that, 
for all x G flflCA', \d a f(x)\ < e. Denote by Cq(£1) the space of all such functions. 
Clearly Cq(Q.) C C k (tt) C C k { fl). Endowed with the norm 

ll/llc^n) = f n max sup \d a f(x)\, (2.4) 

0<|a|<fc xe n 


Cg (SI) and C k (Sl) are Banach spaces. Finally 


C°°(Sl) = p| C k (n ), C°°(n) = f p C fc (D), and Co°(SI) = p C%(Sl). 

k >0 fc>0 fc>0 


When / is a vector function from to IR m , the corresponding spaces will be 
denoted C^(Sl) m or C#(fi,R m ), C k (U) m or C fc (fI,R m ), C k (Sl) m or C k (Sl,W m ), 
etc. 

In dimension one, n = 1, and for a bounded open interval ]a,b[, the notation 
and the definition of C(]a,b[) coincide with the ones of C([a, 6]). For simplicity 
we shall also often write C(a,b) with the implicit convention that C(a,b) stands 
for C([a, b\). 



4 


Introduction 


def 
W - 


y 

z 


G w d = Hl(Q) x L 2 (n ), 


where 77,) (Q) denotes the usual Sobolev space of L 2 -functions, with deriva¬ 
tives, in the distribution sense, belonging to L 2 (fi) and vanishing at the bound¬ 
ary. Then (2.2) can be formally written as 

—— (t) + Aw(t) = Bu(t), (2-5) 

at 


where 


A d = 


0 —7 
A 0 


and 


B = 


0 

B 


Here B G £(R m ;>V) and the operator A is an unbounded operator with a 
dense domain 


V{A) = D H 2 {ft)] x H%(Q) C W. 

Because of the presence of the unbounded operator A, it is clear that the 
concept of a solution for (2.5) is not immediate. Intuitively, if we want (2.5) 
to have a classical solution, then we would need 


G V(A) 

and u(-) G C 1 )!!). On the other hand, —A generates a strongly continuous 
semigroup S(t ) on W, i.e., S(t) is a bounded linear operator on W satisfying 

(i) 5(0) = 7. 

(ii) S(ti + t2) = S(ti)S(t 2 ), 0 < ti,t 2 < oo. 

(iii) 1 1 —> S(t)w. [0, oo) —> W is continuous for each w G W. 

Then we may say that w(t) is a solution of (2.5) if it satisfies 

w(t) = S(t)w o + f S(t — s)Bu(s) ds, (2-6) 

Jo 

where the integral is interpreted in the Bochner sense. 

Now, given a strongly continuous semigroup S(t) on X (say a Banach 
space), it has a unique infinitesimal generator A, a closed unbounded operator 
that is defined on some dense domain T>{A). The converse question, namely, 
when does A generate a strongly continuous semigroup, is a far more difficult 
issue and is the content of the Hille-Yosida theorem. Furthermore, there are 
different kinds of semigroups, and each plays an important role in the study of 
partial differential and functional differential equations. We give an informal 
listing of some of these below. 
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(i) Differentiable: S(t)X C V{A) for t > 0. Then S(t)x € C°°{X) for all 
t > 0 and each fixed x £ X. Partial differential equations of diffusion type 
on a bounded domain with homogeneous Dirichlet boundary conditions 
give rise to such semigroups. (§2.8, Chapter 1 of Part II). 

(ii) Analytic: S(t) is differentiable and admits an analytic extension into the 
complex t-plane satisfying certain bounds. Abstract parabolic equations in 
variational form give rise to such semigroups. (§2.7, Chapter 1 of Part II). 

(iii) S(t) is a group (orthogonal or unitary). The operator —A considered pre¬ 
viously generates a group. This is the content of Stone’s theorem. (Theo¬ 
rem 2.9, Chapter 1 of Part II). 

(iv) S(t) is a compact operator for t large. Hereditary differential systems 
give rise to such semigroups. An extensive study of hereditary differential 
systems is carried out in Chapter 4 of Part II. 

(v) Contraction ||5(f)|| < 1 on 0 < t < oo. Dissipative operators give rise 
to such semigroups. This is the content of the Lumer-Phillips theorem 
(Theorem 2.6, Chapter 1 of Part II). 

An important problem in the control of linear systems is the study of its 
stability. Consider the stability problem for the linear system 

— it) = Ay(t), A: (2.7) 

at 

It is well known that the following are equivalent: 

(a) (2.7) is asymptotically stable. 

(b) (2.7) is exponentially stable. 

(c) \/y 0 G R", / 0 °° \e At yo\l»- dt < oo. 

The stability of (2.7) can be tested by looking for a quadratic Lyapunov 
function: 

V(x) = (x,Px)r«, P = P*> 0. 

This leads to a study of the Lyapunov equation 

A*P + PA = -Q 1 Q> 0, (2.8) 

and if A is a stability matrix Re A < 0, then the solution of (2.8) exists and 
can be written as 

roo 

P= e A ’ t Qe At df (2.9) 

Jo 

and conversely if (2.8) has a positive definite solution, then A is a stability 
matrix. 

The corresponding question of infinite dimensional systems 

= Ay(t ), y(t) £ X a Banach space (2-10) 

dt 

and A the infinitesimal generator of a strongly continuous semigroup S(t) 
leads to a study of the asymptotic behavior of S(t) as t goes to infinity. The 
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theorems characterizing the equivalence of conditions (a) and (c) above and 
related issues are discussed in §2.2 of Chapter 1 of Part II, where Theorem 2.2 
is perhaps the most important. The Lyapunov method leading to the study of 
the Lyapunov equation is the content of Theorem 2.4. The relation between 
the spectrum of A and the stability of the semigroup S(t ) is subtle (see §2.9, 
Chapter 1 of Part II). 

In general, the questions related to the generation of semigroups receive a 
thorough description in §2, Chapter 1 of Part II. 

As we have just discussed, not only do we have to deal with homoge¬ 
neous equations of the form (2.10), where A is the infinitesimal generator of 
a semigroup, but we also have to deal with nonhomogeneous equations 


^(t) = Ay(t) + f(t), 


where / € L p (0,T; X). 


( 2 . 11 ) 


When the nonhomogeneous equation arises from a feedback control prob¬ 
lem, we have to consider equations of the form 


dy 


(t) = Ay{t) + F(t)y(t ) + /(f) on [0, T], 


dt 

M o) = y 


( 2 . 12 ) 


where A is the infinitesimal generator of a strongly continuous semigroup and 
F: [0, T] —> C{X) is strongly continuous (jC(X) is the space of continuous 
linear maps from X to X). This equation leads to the consideration of a 
perturbation of the infinitesimal generator A. 

There are now many concepts of a solution (see Definition 3.1, Chapter 1 
of Part II). Existence and uniqueness of solutions as well as equivalence of 
solutions is discussed in §3.1 to §3.5 of Chapter 1 of Part II. The key ingre¬ 
dient in proving the various existence and uniqueness results is the Yosida 
approximation. 

The question of regularity of solutions is discussed in §3.6 and §3.7. In 
§3.6, the assumption is made that A is a Hilbert space and A is the generator 
of an analytic semigroup and we concern ourselves with maximal regularity, 
namely, that 

“« - Ay 


dt 


and 


have the same regularity as /. Consideration of the nonzero initial condition 
case leads to the study of interpolation spaces (studied in detail in §4, Chap¬ 
ter 1 of Part II) and the main Isomorphism Theorem (Theorem 3.1, Chapter 1 
of Part II). Regularity can also be studied in C([0,T]; X) 3 with X a Banach 
space, and this is carried out in §3.7. 

We often have to study nonhomogeneous equations 


3 C([0, T];X) is the linear space of continuous functions / : [0, T\ 
with the sup norm. It will also be denoted as C(0,T; X). 


X endowed 
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§( t) = Ay(t)+f(t ) (2.13) 

on the infinite time interval [0, oo[. These situations arise from consideration 
of feedback control problems and related stability issues. When A has a pure 
point spectrum and the infinite part of the spectrum is stable and the unstable 
part is finite dimensional, these equations can be effectively studied in [0, oo[ 
(§3.9, Chapter 1 of Part II). 

In Parts IV and V of the book where we study optimal control problems 
with a quadratic cost function where control is exercised through the bound¬ 
ary (or pointwise), we shall need the concept of fractional powers of closed 
operators and the semigroups they might generate. This is the subject of §5 
and §6 of Chapter 1 of Part II. 

Control of partial differential equations where control is exercised through 
the boundary leads to considerable technical difficulties. To obtain an under¬ 
standing of these difficulties, consider again a vibrating flexible string 


d 2 y 

dt 2 


for the transversal displacement 


d 2 y 
dx 2 


y(t, x) on 0 < x < 1, t > 0. 

Assume that 

2 /( 0 , t) = 0 on t > 0 

and control is exercised through the end point x = 1 

y{l,t) = u{t), f >0. 


(2.14) 


(2.15) 


We would like to control the pair 

(»(•,<),f(-.o) 

so that the initial state 

dy 

y(x, 0) = y 0 (x), —(x,0)=v 0 (x) 

on 0 < x < 1 is brought to 

y(x,T ) = 0, -^-(x,T) = 0 on 0 < x < 1 (2-16) 

dt 

in some finite time T > 0. 

We try to transform the system to a distributed control framework 


aw . . - . , ~ . , 

— (f) = Aw(t ) + Bu[t) 


(2.17) 
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by defining the state w(-) and the operators A and B appropriately. For this 
purpose, define 


Y{x,t) = y(x,t) 



Si(x)u(t)(x) dx 


(2.18) 


where the Dirac measure di has a unit weight at x = 0. Then formal calcula¬ 
tions will show that 


2/(1) *) - 2/(1-,*) = <5i u(t), 


or equivalently, 

y(l,t)=u(t) with y(l-,t) = 0 . 
Hence we obtain the distributed control system 


d 2 Y d 2 Y 


— S[u(t) 


dt 2 dx 2 

(<5( is the distributional derivative of <5i) with the boundary conditions 


(2.19) 


Y{0,t) = 0 and Y(l_,i)=0 on t > 0, 


and this can be formally put in the form (2.17). 

In general, boundary control problems for partial differential equations 
lead to boundary operators B that are unbounded and may involve distribu¬ 
tions as in this example. The dual of boundary control problems are bound¬ 
ary observation problems, and in the most general situation, both control 
and observation are exercised through the boundary leading to control and 
observation operators that are both unbounded. 

In some sense, when control of partial differential equations is exercised 
through the boundary, the parabolic case (the corresponding semigroup is an¬ 
alytic) and the hyperbolic case (the corresponding semigroup is a group) have 
to be treated using different methods. Chapters 2 and 3 deal with the control 
of parabolic systems when control and observation is exercised through the 
boundary, leading to control and observation operators that are unbounded. 

Chapter 2 of Part II is a summary exposition of variational theory of para¬ 
bolic systems. This theory can also be applied to certain wave equations where 
damping is present. A systematic exposition of this method can be found in 
J. L. Lions and E. Magenes [1], and this theory was extensively used by 
Lions in his book Control of Partial Differential Equations (cf. J. L. Li¬ 
ons [3]). The main reason for including this chapter in the book is to explain 
the Method of Transposition , which is later used in various parts of the book 
(for example, in the study of delay systems in Chapter 4 of Part II and in the 
study of controllability in Chapter 1 of Part III). The idea of the Method of 
Transposition is to define an integral or weak version of the original equation 
involving the adjoint of the operator A, using Green’s formula and integration 
by parts (§2.3 and in particular (2.5) of this chapter) and then to obtain a 
smooth adjoint isomorphism of the form 
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between suitable spaces. It should be noted that the Method of Transposition 
when combined with the change of variable idea of the previous chapter allows 
one to treat parabolic systems with control exercised via Dirichlet boundary 
conditions. As the boundary control operator becomes “rougher” (e.g., Dirich¬ 
let case), the solution also becomes “rougher” and it becomes more difficult 
to perform a “smooth” observation. The balance between the relative “rough¬ 
ness” or “unboundedness” of the control and observation operators is a key 
technical issue in the solution of the quadratic control problem as we shall see 
in Parts IV and V. 

Chapter 3 of Part II is concerned with semigroup methods, and one of the 
main theorems in this chapter is an Isomorphism Theorem (Theorem 2.3), 
which uses regularity results for analytic semigroups and interpolation spaces 
(§4 of Chapter 1). The other key idea used in this chapter is the use of a 
change of variable to define a new state and make sense of the state space 
system as an input-output map (see Theorem 2.3 and §3.4, Chapter 3). 

The final chapter of this part of the book is concerned with the represen¬ 
tation problem for linear functional differential equations with general control 
and observation mechanisms. A fairly complete modern treatment of this sub¬ 
ject that covers both retarded and neutral Functional Differential Equations 
(FDE), difference equations, integro-differential equations, and other equa¬ 
tions with a hereditary structure is now available (cf. M. C. Delfour and 
J. Karrakchou [1, 2]) . They can now all be treated in the same frame¬ 
work. However, we have chosen to concentrate on FDEs of the retarded type 
to provide a better understanding of the basic ideas and constructions, but 
everything is readily extendable to more general hereditary structures. The 
prototype problem here can be written as 

! , n 

*(‘) = EM*-*) + «(<-01, (2.20) 

y(t) = aox(t) + a\x(t — N) + b 0 u{t) + biu(t — N ), 

where u(-) denotes the control variable and y(-) denotes the observation. Two 
questions need to be resolved to obtain a “current” theory of existence, unique¬ 
ness, and representation of solutions to such systems. The first is the choice 
of an appropriate function space for initial conditions, and the second is the 
choice of a minimal state space for these systems. The choice of initial con¬ 
ditions, namely space of continuous functions C(—h, 0;K") and the product 
space M p (—h, 0;R") = R” x L p (—h, 0; l n ), and the corresponding questions 
of existence and uniqueness of solutions in appropriate function spaces are 
discussed in §3 of Chapter 4 of Part II. §4 is concerned with the state space 
representation of FDEs. The key concept of structural operators (§4.4), which 
intuitively describes the way the systems combine and transform initial condi¬ 
tions over the initial interval is introduced here. A complete modern treatment 
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of the various adjoint systems and semigroups arising out of the original sys¬ 
tem is described in this section. Finally, §5 and §6 give a state space treatment 
of linear FDEs of the retarded type when control and observation in various 
forms are present. All this readily extends to other types of systems with a 
delay structure. It should be mentioned that the state space point of view is 
essential for the study of optimal control problems considered in Parts III to 
V. 


Notes: some related books on the control of linear 
systems that have appeared since 1992 

Several books related to this one have appeared in the ensuing period between 
the publication of the first edition of the book and its current revision. 

In optimal control, the two-volume book of I. Lasiecka and R. Trig- 
GIANI [15,16] that appeared in 2000 covers in greater detail and provides new 
results on optimal control of parabolic and hyperbolic systems with quadratic 
cost functions. The book of X. Li and J. Yong [1] published in 1995 is con¬ 
cerned with optimal control of partial differential equations, and in the last 
chapter, the author discusses linear quadratic optimal control problems, both 
over a finite and an infinite time horizon. 

The books of R. F. Curtain and H. Zwart [1] published in 1995 and 
O. J. Staffans [2] in 2005 are concerned with state space realization the¬ 
ory of linear input-output infinite dimensional systems as well as qualitative 
properties such as stability, controllability, and observability. The book by 
Staffans has considerable overlap with our treatment of semigroup theory as 
well as representations of partial differential equations in terms of semigroups. 
Staffans’ work also presents a detailed treatment of the theory of B. Sz.-Nagy 
and C. Foias [7,8] on contractive semigroups and their unitary dilations from 
1965 to 1967. These ideas are intimately connected with scattering theory as 
developed by P. Lax and R. S. Phillips [1]. Finally, the systems point of 
view as exemplified in the Russian work of V. M. Adam JAN, D. Z. Arov, 
and M. G. Krein [1 to 5] receives a detailed treatment here. 

The book of H. O. Fattorini [5] published in 1999 also deals with opti¬ 
mal control of nonlinear partial differential equations via the Maximum Prin¬ 
ciple. Finally, the reader is referred to the book of A. V. Fursikov and 
O. Yu. IMANUVILOV [1] in 1996 that studies null controllability via Carle- 
man estimates. 

We have not cited other references because we confined ourselves to linear 
control problems. 
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Control of Linear Differential Systems 


1 Introduction 

This Part I serves the purpose of an introduction to Parts III to V of the book, 
which are mainly concerned with the quadratic cost optimal control problem 
for distributed parameter systems and systems with time delay, both over a 
finite and an infinite time interval. For problems over a finite time interval, the 
main tool used is Dynamic Programming, which leads to a Hamilton-Jacobi 
equation for the value function. For the class of control problems considered, 
the Hamilton-Jacobi equation can be explicitly solved via the study of an 
operator Riccati equation. The study of the operator Riccati equation when 
control is exercised through the boundary in the case of distributed parameter 
systems or when delays are present in the control in the case of systems with 
time delay poses additional technical difficulties. The results of Part II are 
needed to overcome these difficulties. For problems over an infinite time inter¬ 
val, the concepts of controllability and observability (and the weaker concepts 
of stabilizability and detectability) play an essential role in the development 
of the theory. 

Problems of optimal control with a quadratic cost function, not necessarily 
definite, are of interest in iJ°°-theory and differential games. These problems 
are related to the theory of dissipative systems. The last two sections of this 
chapter present an introduction to these problems. 


2 Controllability, observability, stabilizability, and 
detectability 

In this section we present the theory of controllability and observability for 
finite dimensional linear systems in a manner that has implications in the 
study of controllability and observability for infinite dimensional systems. In 
particular, we show that if the system is controllable, then the transfer from 
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the zero-state to any other state can be carried out by means of minimum 
energy controls. It is the same idea, which is later used in the theory of exact 
controllability of hyperbolic (second order) systems. The mathematical tech¬ 
niques needed to accomplish it, however, are far more difficult. Throughout 
this book N denotes the set of integers and R and C the respective fields of 
real and complex numbers. In this chapter the norm in R d will be denoted | • | 
irrespective of the dimension d of the space. We shall use || • || to denote the 
norm in various Hilbert spaces, (•,•) to denote scalar product and * denotes 
the adjoint of an operator (and also the dual space). 

Consider the linear finite dimensional control system in the interval [0, T\: 

{ dx 

— (t) = Ax(t) + Bu(t) in [0, T], ^ ^ 

y(t) = Cx(t) 

where the state x(t) G R", the control functions ( t i—> u(t)) G L 2 (0,T;R m ), 
the output y(t ) G R p , and A G £(R"; R”), B G £(R m ;R”), and C G 
£(R";R P ). 

We assume that the initial state a;(0) = 0. The solution of the linear 
differential equation (2.1) can be written as 

pt 

L t u d = x(t;u) = / e A< ' t ~ s ' ) Bu(s) ds, (2.2) 

Jo 

where L t is a linear bounded transformation from L 2 (0,f;R m ) into R". 

2.1 Controllability 

Definition 2.1. We say that the system is controllable (from 0 G R ra ) in [0, T] 
if given any x G R ra , there exists a control function u(-) G L 2 (0,T;R m ) such 
that 

x{T ; it) = x. □ 

Controllability in [0, T] is therefore equivalent to the surjectivity of the map 
u i—> Ltu. We now give necessary and sufficient conditions for controllability 
using elementary facts from the theory of linear transformations on Hilbert 
spaces. 

Let H and K be Hilbert spaces, and let A G C(H;K). Let A* G C(K*; H*) 
be the adjoint operator. In the sequel we identify H and H* and K and K*. 
Let 7 Z(A) denote the range of the operator A and A f(A) denote the null space 
of A. J_ denotes the orthogonal complement of a closed subspace. 

Proposition 2.1. The following relations are true: 

(i) 7 Z{A) C A/^H*)- 1 - and TZ(A) =Af(A*) ± 4=4- 1Z(A) is closed. 

(ii) 1Z(A*) C A/'(A)- l and 1Z(A*) = AZ^A)- 1 - 4=4- 7 Z(A) is closed. 

(JZ(A) closed 4=4- 1Z(A*) is closed.) 



2 Controllability, observability, stabilizability, and detectability 


15 


(iii) A r(A) =TZ(A* ) ± . 

(iv) A f(A*) =TZ{A) ± . 

(v) Furthermore 

1Z(A) is closed 3c > 0 such that ||/i|| < c||A/i||, V/i € H. 

Using the above, we can prove the following proposition. 

Proposition 2.2. The following are true: 

(i) 1Z(A) is dense in K •£=>■ fif(A*) = {0}. 

(ii) A f(A) = {0} 1Z(A*) is dense in H. 

(iii) 7 Z(A) is dense in K 4==> AA* : K —> K satisfies AA* > 0. 

(iv) A f(A) = {0} A*A: H —> H satisfies A*A > 0. 

(v) A € C(H\ K ) is invertible •<=>■ TZ(A) = K , A f{A) = {0} 

3c > 0, such that ||/i|| < c||A/i||, \/h € H, 

3c > 0, such that ||fc|| < c||AA*/c||, Vfc g K. 

Remark 2.1. Much of the above extends to operators A that are densely de¬ 
fined and closed to spaces H and K, which are Banach spaces. For proofs of 
these facts, see, for example, M. Schechter [1], For a use of these ideas in 
a systems context, see M. C. Delfour and S. I\. Mitter [7]. □ 

We can immediately use the above to get a necessary and sufficient con¬ 
dition for controllability. Using (2.2) and noting that 

L* t : IT -> i 2 (0, T ; R m ) 

: y B*e {T ~ ) y, 


we get 

W(0,T) = f L t Lt = [ e A{T - s) BB*e A ^ T ~ s) ds. (2.3) 

Jo 

Hence we have proved. 

Theorem 2.1. The system (2.1) is controllable in[0,T] if andonly ifW(0,T) > 
0 (positive definite). 


We can transform this criteria of controllability to an algebraic criterion by 
noting that 


Af(W(0,T)) =A f(C), 


(2.4) 


where 


C = 


B:AB: ■ ■ ■ \A n ~ 1 B 


B:AB: ■ ■ ■ :A n ~ 1 B 


This can be proved as follows. 
Let x G Af(W(0,T)). Then 


(2.5) 
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r T 

0 = (x, W(0, T)x) = / \B*e A *( T ~ t ' > x\ 2 dt, 

Jo 

and hence B*e A ( T ~ t ' > x = 0, Vt € [0, T]. 

Differentiating (n — l)-times with respect to t and setting t = 0, we get 

B*x = 0, B*A*x = 0,...,B*A* n ~ 1 x = 0, 


and hence 

x G A f(C). 

Conversely, suppose x G A/"(C). By the Cayley-Hamilton theorem, 

n— 1 

e A(T-t) =J2a i {T-t)A i . 
i —0 


Hence 


x*W{0,T) = 


n—1 


^2ai{T ~t)x* A 1 B 


i=0 


B * e A*(T-t ) dt 


Now x*A l B = 0, i = 0, ...,n — 1, because x G A/"(C). Therefore, 
x*W(0,T) = 0 and because W(Q,T) is symmetric, 

x G Af(W(0,T)). 

Hence using the fact that W (0, T ) is a symmetric matrix 

K(W{0,T)) =7 1(C). 

But 

K(C) = 1Z([B:AB: ■ ■ ■ \A n ~ l B ]), 
and hence we have proved the following theorem. 

Theorem 2.2. The following conditions are equivalent: 

(i) System (2.1) is controllable in [0,T]. 

(ii) W(0, T) > 0 (positive-definite). 


(iii) rank 


B.AB-. ■ ■ ■ :A n ~ 1 B 


( 2 . 6 ) 

(2.7) 


When the system is controllable, we shall refer to (A, B) as a controllable pair. 


It is of some interest to establish that if the system is controllable, then 
we can transfer the state xo at time to to the state x\ at time t± by using a 
control u*. which has the least energy 



|w*(s)| 2 ds 



2 Controllability, observability, stabilizability, and detectability 


17 


among all controls that transfer the phase (xo, to) to the phase (xi,ti). 
To establish this, let us use the notation 


— pMt-s) 


( 2 . 8 ) 


(2.9) 


( 2 . 10 ) 


<£(f, s) = e 

Introduce the adjoint system 

^(t) = —A*p(t) in [t 0 , *i[, 

[ p (ti) = n, 

where rj will be specified later. The solution of (2.8) is given by 

P(t) = 

Now choose the control 

it*(f) = —B*p(t) = —B*<&* (ti,t)r). 

If the control is to transfer (xo, to) to (xi,ti), we must have 

xi = x{ti) = $(ti,t 0 )x 0 - [ $(ti,t)BB*$*(t 1 ,t)dtr), 

Jt 0 

and hence if the system is controllable and we choose 
V = W~ 1 (t 0 ,t 1 )[${t 1 ,to)x 0 - xi], 

the desired transfer will be effected. Let us now prove that u*(t) is the mini¬ 
mum energy control. 

Let u(t) be some other control that effects the desired transfer. Then 
xi = <£(ti, to)xo + [ dtt 

Jto 

= $(ti,to)xo + f <&(ti,t)Bu*(t)dt. 

Jto 


Therefore 


Hence 


/ to 


$(ti,t)B[u(t) — u*(t)} dt = 0. 


[ ([w(t) — u*(t)],—B*0*(ti,t)r]) dt = 0 

Jto 


(■ u(t ) — u*(t),u*(t)) dt = 0. 


and 
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Therefore 


f \u(t.)\ 2 dt = f \u(t) — u*(t) + u*(t)\ z 
J tn J to 


dt 


'to 

/“ 

/to 


|w*(f)| 2 dt 


| u(t) — u*(t) | 2 dt 


/ to 


> 


Ax 

/ |u*(f)| 2 c?f if 

Jt n 


Suppose now that U and X are infinite dimensional Hilbert spaces, 
A: X —> X is an unbounded linear operator with domain D(A), and 
B: U —> X is a bounded linear operator. Then there is a difficulty with car¬ 
rying through the arguments given earlier (for example, TZ(Lt) need not be 
a closed subspace of X). Nevertheless, 7 Z(Lt) can be given the structure of a 
Hilbert space with continuous injection in X (Proposition 2.1 in Chapter 1 of 
Part II). Furthermore, there is a need to make a distinction between approx¬ 
imate controllability (7 Z(Lt) is dense in X) and exact controllability (whose 
definition is somewhat subtle, see Definition 2.2 in Chapter 1 of Part III); 
indeed TZ(Lt) = X will usually not hold. However, an abstract criterion for 
exact controllability is related to an estimate on LtLj, (see Proposition 2.2; 
this chapter). It is also of interest to note that the minimum energy control 
viewpoint of verifying exact controllability as outlined in this section extends 
to infinite dimensional situations, but of course at the cost of using much 
more elaborate technical machinery. Chapter 1 of Part III gives a treatment 
of exact controllability for parabolic and hyperbolic partial differential equa¬ 
tions when control is exercised in a distributed manner and when control is 
exercised through the boundary. 


2.2 Observability 

We now discuss the dual concept of observability. For this purpose we may 
assume that the input is known, and because we are dealing with linear time- 
invariant finite dimensional systems, we may take u(t) = 0, t € [fo ? oo[. Con¬ 
sider therefore the system 


dx , . , . . 

-ft) = Ax(t), 

y(t) = Cx(t), 


and let the initial state x(t o) = Xq, for some arbitrary Xq . 
The solution of (2.11) can be written as 

y(t) = Ce^-^x o. 


( 2 . 11 ) 


( 2 . 12 ) 


Definition 2.2. The system (2.1) is said to be observable in [to, ti] if the map 
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O : R" -> L 2 {t 0 ,t 1 ;R p ): x 0 -» y(-) = Ce A( ~ to) x 0 


is injective. □ 

The definition expresses the fact that we can recover uniquely the initial 
state from a knowledge of the output y(-) in the time interval [foAi]- The 
interval [ioAi] can in feet be taken to be arbitrarily small. Now, 

O is injective Af{0) = {0} <£=>■ Af(0*0) = {0}. 

An easy computation shows that 

£{t 0 , ii) d = 0*0 = [ 1 c *Ce {tl ~ t)A dt , 

Jto 

and clearly 


A f(0*0) = {0} £(to,t±) > 0 (positive-definite). 

It is also easy to show that 


N(0*0) = Af([C*':A*C*: ■ ■ ■ : A* n ~ 1 C*]*[C*:A*C*: ■ ■ ■ \A* n ~ 1 C*]), 

= Af([C*:A*C* ■ ■ • A*” _ 1 C*]) 

and hence, we have proved the following theorem. 

Theorem 2.3. The system (2.1) is observable if and only if 

rank [C*:A*C*\- ■ ■ iA* 11 " 1 !?*] = n. 

When the system is observable, we shall refer to (A, C ) as an observable 
pair. 


2.3 Duality 

There is a formal duality between the concepts of controllability and observ¬ 
ability. For this purpose, we introduce the dual system 

= (213) 

[v(t) = —B*£(t), 

which evolves backward in time. 

Then mathematically, 

• The system (2.1) is observable <==>■ The system (2.13) is controllable. 

• The system (2.13) is observable -£=> The system (2.1) is controllable. 
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In this book we do not study observability of partial differential equations 
but exploiting the above duality ideas, much of the theory of controllability 
developed in Chapter 1 of Part III can be used to develop a theory of observ¬ 
ability for partial differential equations (even with unbounded observation 
operators). 

Conceptually, controllability of a system permits the choice of feedback 
controls resulting in certain desirable (e.g., stability) properties of closed loop 
systems, whereas observability of a system permits the design of state estima¬ 
tors with desirable properties. We shall discuss this in a later section. 

2.4 Canonical structure for linear systems 

In this section we wish to obtain a decomposition (structure) theorem for the 
system (2.1) that is not necessarily controllable and observable. Let us denote 

by 

V := R(C) = 7l([B:AB: ■ ■ ■ : A n ~*B)). 

V is the smallest A-invariant subspace containing the image of B. Let us also 
denote by 

W := Af(0) = Af([C*':A*C* ■ ■ ■ : A* n ~ 1 C*]), 

and clearly W is the smallest A* -invariant subspace containing the image of 
C*. 

Now we may write the state space X := R" as 

x = (v n w - 1 ) © ( v - 1 n w^) © (v n w) © ( v - 1 n w). 

Then there exists a basis in which we may write the system as 

Xi(t) 

d_ X2 (t) 
dt x 3 (t) 
xa (t) 


In the above, (An,Bn), (A 33 ,B 3 ) are controllable pairs and (An,Ci), (^ 22 ,^ 2 ) 
are observable pairs. 

2.5 The pole-assignment theorem 

An important consequence of a linear system possessing the controllability 
property is that by means of linear state feedback control, the poles of the 
corresponding closed loop system can be placed in arbitrary locations. 


An A12 Ai 3 0 X\(t) Biui{t) 

0 A 2 2 A 23 A 2 4 X2 (t) 0 (o 

0 0 A 33 0 x 3 {t) + B 3 u 3 (t) ’ 1 ■ ’ 

0 0 A,j 3 A 44 X4 (t) 0 

Xl(t) 

y(t) = [Ci C 2 0 0] . (2.15) 

Xi (t) 
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By state feedback control, we mean that the control law is of the form 

u(t) = Kx(t) + v(t), 
where K: R™ —> R m and v(-) is a reference input. 

Theorem 2.4. Let £ = {A* G C, i = 1,2,..., n} with the proviso that if A i 
is complex, then its conjugate AG £ . Then the system is controllable if and 
only if there exists a feedback control u(t) = Kx(t ) for some feedback matrix 
K such that the spectrum of A + BI\ is equal to £. 

Proof. We start by noting two facts: 

(i) Controllability is invariant under non-singular linear transformations 
of state space. In case m = 1, that is, we are dealing with the system: 

(IT 

— (t) = Ax(t)+bu(t), u(t) G M and b G R", 
dt. 

then assuming ( A , b) is a controllable pair, there exists a non-singular linear 
transformation T : R” —> R" such that the above system transforms to 



' 0 

l 

0 ... O' 


'O' 


0 

0 

1 : 



1 = 

0 

0 

0 

... 0 1 

, b = 




a 2 

• • • Q-n—l &n_ 


_ 1 _ 


It is then easy to see that if the characteristic polynomial corresponding to 
the desired spectrum £ is 

X = s n ~ PuS 71-1 - fas - Pi, 

then the feedback law 


u(t) = Kx{t) + v(t), K = diag(/3i -ct\,...,P n - a n ) 

transforms 

dx ~ . . 

— = Ax(t) + bu(t ) 
dt 

to 

^ = (A + bk)x(t ) + bv(t) 

such that the spectrum of (A + bK ) in £. 

(ii) Controllability is not destroyed by state feedback. That is 


n 


B:(A + BK)B: ■■■':(A + BK) n ~ 1 B 


= n 


B:AB: ■ ■ ■ \A n - n B 


Now the general case is reduced to the case m = 1 by virtue of the following 
lemma. 
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Lemma 2.1. Let 0 / t € TZ(B). If (A,B) is a controllable pair, there exists 
a matrix K £ £(R m ;R n ) such that (A + BK,b) is a controllable pair. 

Let b\ = b and let n\ = dimension of the cyclic subspace X\ generated by 
{A, fri). Let X\ = bi and define Xj = Axj-i + b\(j = 2,..., ni). Then the Xj, 
j = 1,..., m, forms a basis for the cyclic subspace generated by (A, bi). If 
n\ < n, choose b 2 € 'R.(B) such that b 2 £ X\. As (A,B) is controllable, such 
a b 2 exists. Let n 2 be the largest integer such that 

1 ? *^2 j • • • j ^ni •> ^2 1 Ab 2 ,..., A n *-% 


are independent. 

Define 

*£ni — Ax ni 1 A b 2l i 1 , 2 ,..., n 2 . 

Then x±,x 2 ,..., x ni +„ 2 is a basis for the cyclic subspace generated by (A, 61 + 
b 2 ). Continuing in this way, we eventually get an independent set of vectors 
Xi,... ,x n , and 

Xi+i = Axi + bi, i = l,...,n-l, 

and bi £ TZ(B). 

As bi = But for some Ui € R m (the control space) and the Xi,... ,x n are 
independent, there exists a AA such that 

BKiXi = bi, i = l,...,n, 

where bi £ 1Z(B) is arbitrary. Therefore 

(A + BKi)xi = Xi+ 1 , i = 1,2,... ,n - 1, 

and hence 

Xi = (A + BKi) l ~ 1 b, i — 1 ,... ,n. 

Therefore (A + BI\\, b) is a controllable pair. 

Hence the problem has been reduced to the case of n = 1 and the control 
law K = A'i + bK* achieves the desired property. 

To prove the theorem in the other direction, let A*, i = 1,... ,n, be real 
and distinct with A,; spectrum of A. Choose K £ £(R m ;R") such that 
spectrum (A + BK) = {Ai,..., A„}. Let x*, i = 1,..., n, be the corresponding 
eigenvectors. Hence 

Xi = (Ail — A)^ 1 BKxi, i = 1 , 2 ,..., n. 

Now 

n 

(A I-A)- 1 = Y,P j WA. i -\ 
i =1 

where pj( A) are rational functions defined on the complement C\cr(A) of the 
spectrum a (A) of A. Hence 
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Xi = ^p j (\ i )A j - 1 BFx i G K([B:AB: ■ ■ ■ : A^B]). 

3=1 

Now the ajj’s span R" and hence 1Z([B\AB\ ■ ■ ■ \A n ~ 1 B\) = n. □ 

No satisfactory result similar to the pole-assignment theorem is known in 
infinite dimensions. It would be interesting to prove a result of this kind for 
delay systems 

! dx 

— (f) = Aix{t) + A 2 x{t - h) + Bu(t), 
at 

x(0) = foe IT, 

a:(0) = fo{9 ) a.e. 9 G [— h, 0), fo G L 2 {—h , 0; R"). 

Corollary 2.1. If the system is controllable, then there exists a feedback con¬ 
trol u(t ) = Kx(t) such that the closed loop system 

(IT 

-( t) = (A + BK)x(t ) 

is asymptotically stable. 


2.6 Stabilizability and detectability 


The structure theorem of linear systems and the pole-assignment theorem 
motivate the introduction of the concepts of stabilizability and detectability. 
Consider the input-state part of the control system (2.1): 


-(tm=Ax(t) + Bu(t). 

Then from the structure theorem, we know that there is a coordinate system 
in which the above system has a representation 


d x\ 
dt x 2 


0 1 ) 


An Ai 2 

X\ (t) 

0 A 22 

x 2 (t)_ 


B n 
0 


■u{t) 


(2.16) 


and (A n , B n ) is a controllable pair. Hence, from the corollary of the pole- 
assignment system, we can stabilize the system by means of the control u(t) = 
Kxi(t ), provided 

dXO / , T _ / , 

— (f) =A 22 x 2 (t) 

is asymptotically stable. 

Definition 2.3. (i) We say that the system (2.1) is open loop stabilizable if 
VccqGR", 3u G L 2 (0, oo; R m ) 


such that the solution x(t-,xo,u) of (2.1) satisfies 



| x(t; xq, u )\ 2 dt < oo. 


(2.17) 
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(ii) We say that the system (2.1) is stabilizable by feedback if there exists a 
feedback matrix K such that 


u(t) = Kx(t ) 

and 

^ = (A + BI\)x(t) 

is asymptotically stable. □ 

Remark 2.2. For finite dimensional linear systems, if the system is open loop 
stabilizable, then it is stabilizable by feedback and conversely. Note that by 
the previous discussion, stabilizability is a weaker concept than controllability, 
since stabilizability only requires that the uncontrollable part of the system 
be asymptotically stable. □ 

The dual of the concept of stabilizability is that of detectability. This is 
best discussed by considering the dual system 

= (2.18) 

which involves only the state-output part of the system. 

Definition 2.4. The system (2.1) is said to be detectable if the dual system 
(2.18) is stabilizable by feedback. □ 

Remark 2.3. Detectability requires that the unobservable part of the system 
be asymptotically stable and hence is a weaker concept than observability. □ 

A matrix test for stabilizability and detectability can be given. 

Theorem 2.5. The following properties are equivalent: 

(i) (A, B) is a controllable pair. 

(ii) rank[A/ — A:B] = n, VA € C. 

(iii) rank[A/ — A:B] — n, for each eigenvalue A of A. 

Proof. Note that (ii) and (iii) are equivalent because the first n x n block of 

the nx ( n+m ) matrix [A I—A'.B] has full rank whenever A is not an eigenvalue 
of A. 

We now prove that (i) => (ii). For this purpose, assume that rank[A/ — 

A'.B] < n for some A € C. Hence the space spanned by the rows of [A/ — A'.B] 
has a dimension less than n and therefore there exists some vector z* £ R" 

and some A such that z*[XI — A'.B] = 0. Hence 


z*A = A 2 * and z*B = 0 
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and therefore z*A k B = A k z*B = 0, VAA and hence 


= 0 , 


which contradicts controllability. 

To prove (i) => (ii) assume (A, B) is not a controllable pair. Then from the 
structure theorem , there exists a non singular linear transformation T : R" —> 
R™ such that 


(A,B) 


A = 


An A12 
0 A22 


,B = 


B 1 
0 


where An, B± is a controllable pair and An is r x r with r < n. Let A be an 
eigenvalue of A% 2 with the corresponding eigenvector v so that 


v*(XI — A 22 ) = 0. Then the n-vector 0), 


w = 


0 

v 


is such that 


w*A = \w* and w*B = 0. Hence z = (T*) 1 w ^ 0 satisfies z*(XI — 
A)T~ l \B = 0, and therefore, z*(XI — A:B) = 0 contradicting (ii). □ 

Corollary 2.2. (i) ( A,B ) is stabilizable if and only if 


rank [A/ — A:B\ = n, VA G C, Re A > 0. 
(ii) Dually ( A , C) is detectable if and only if 


rank 


XI - A* 
C* 


= n, 


VA € C such that Re A > 0. 


Corollary 2.2 is generalized to an infinite dimensional setting when A is the 
generator of a strongly continuous semigroup 1 on a Hilbert space H with 
e tA compact for t > 0 (and indeed for more general situations) and B G 
C(U,H) and C G C(H;Y) and U and Y are Hilbert spaces (Proposition 3.3 
of Chapter 1 in Part V). 


2.7 Applications of controllability and observability 

The concepts of controllability, observability, and the slightly weaker notions 
of stabilizability and detectability have important applications in diverse areas 
of systems theory and optimal control. In this section we present two such 
applications. The first application is for the theory of stability and tests for 
stability via the Lyapunov equations. Our second application is for regulator 
theory, where we show that if a system is controllable and observable, then 
we can build a compensator to regulate the system in a satisfactory way. 

cf. Definition 2.1 on page 89. 


1 
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2.7.1 Stability 


Our first application is to the study of stability of linear differential equations 
via the Lyapunov method. 

Consider the stability problem for the equation 

(IT 

— (t)=Ax(t), (2.19) 

at 

It is well known (cf. Chapter 1 in Part II) that the following are equivalent: 

(i) (2.19) is asymptotically stable. 

(ii) (2.19) is exponentially stable. 

(iii) Vcco € R™, / 0 °° le^rrol 2 dt < oo. 

To test for stability of (2.19), we look for a Lyapunov function of the form 
V(x) = (;x , Px), P* = P > 0 positive definite. 

Computing the derivative of V along trajectories of (2.19), we get 

^ = (x,A*P + PAx), 

and if it is to be negative, we require that 

A*P + PA = —Q, Q > 0 positive definite. (2.20) 


It is well known that if A is a stability matrix (all its eigenvalues have a 
strictly negative real part), then the solution of (2.20) can be written as 

/»oo 

P= e A “ t Qe At dt , (2.21) 

Jo 

and conversely if (2.20) has a positive definite solution, then A is a stability 
matrix. A generalization of these results in infinite dimensional spaces has 
been extensively discussed in Chapter 1 of Part II. 

Now suppose that Q > 0 and factorize Q as Q = C*C, C € £(R P ;R"). 
Introduce the state-output system: 


dx, . ... 

— (f) =Ax{t), 

y(t) = Cx(t). 


( 2 . 22 ) 


Definition 2.5. The state-output system is said to be asymptotically output 
stable if 


/»oo 

Vx € R", / \Ce At x \ 2 dt < oo. 

Jo 


□ 
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Now it is easy to see that if ( A , C) is an observable pair and A is asymptotically 
stable, then the equation 


A*P + PA = —C*C 


has a solution and 

POO 

P= e A t C*Ce At dt > 0 (positive definite), 

Jo 

the positive-definiteness being a consequence of observability. Conversely if 
the state-output system is asymptotically output stable and if (A, C) is an 
observable pair, then A is asymptotically stable. We can now weaken this 
further. 

Theorem 2.6. If the state-output system is asymptotically output stable (by 
some feedback matrix K) and if (A, C ) is a detectable pair, then the system 

§0 t) = (A + BK)x{t ) 

is asymptotically stable. 

Proof. By hypothesis there exists a K* G £(R";M P ) such that (A* + C*K*) 
is a stability matrix and hence (A + KC) is a stability matrix. Now write 

dx, . ... 

-(() = A x(() 

as 

rjqp 

=-(i) = (A + KC)x(t) - KCx(t), 
dt 

and we can write its solution as 

x(t) = e {A+KC)t x + [ e (A+KC){t - s) KCx(s)ds. (2.23) 

Jo 

Hence 


■ POO 

1/2 

■ POO 

/ \x(t) 2 dt 

< 

/ \ e ( A+KC »x\ 2 dt 

Jo 


Jo 



POO 

rt 

2 

1/2 

+ 

l 

/ e {A+KC){t ~ s) KCx(s) ds 

Jo 

dt 

. (2.24) 


Furthermore, as (A + KC) is a stability matrix, there exists a > 0 and M > 1 
such that 

\/x G IT, \e (A+KC)t x\ < Me~ at \x\, 

and the second term of the right-hand side of inequality (2.24) can be ma¬ 
jorized by 
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Me- a ^ s) \\K\\ \Cx(s)\ds 


i 2 


dt. 


Now introduce the function 


f(s) = 


jM\\K\\e~ as , s> 0, 

1 0, otherwise 


and 


|C'ar(s)|, s > 0, 

0, otherwise. 


9(s) = 

Now / G L 1 (—oo,oo;R) and g G L 2 {— oo,oo;R). Hence by Young’s ineciuality 

\\f*9\\L’<\\f\\Li.\\9\\L*, 


where 


/ OO ft 

f(t- s)g(s)ds = / M\\K\\e~ a{t ~ s) \Hx(s)\ds. 

-oo J 0 

This proves the theorem. □ 

Remark 2.4. This theorem and its proof generalize to certain infinite dimen¬ 
sional Hilbert space situations and have implications in the study of the alge¬ 
braic Riccati equation. See §3.4, Chapter 1 of Part V. □ 


2.7.2 Compensators for linear systems 

Consider the linear control system 

(§<*> = Mt) + (2.25) 

[y(t) = Cx(t). 

We have seen that if (H, B) is a controllable pair, then the spectrum of the 
closed loop system can be made arbitrary by state feedback. We now wish to 
discuss the situation where full-state feedback is not available and the control 
has to be of the form 


u(t) = f A(t — s)y(s) ds + v(t), (2.26) 

Jo 

where the kernel A corresponds to some finite dimensional system and v(t) 
is a reference input. We would like to investigate the properties of the corre¬ 
sponding closed loop system. We shall construct such a control by 

(i) constructing a state estimator x(-) from the observations y(-), 
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(ii) and by constructing an appropriate control as a linear function of the 
estimate x(t). 

We first construct such an estimator in the form 

! r] / t * 

— S/j = Ax(t) + Mu(t) + Bu(t), 
v(t)=y(t)-Cx(t), (2.27) 

and M is to be chosen later. 

The vector v(-) has the interpretation as an “innovation” function; that 
is, v(t) is the new information in the output y(t) at time t not contained in 
Cx(t). Let e(t) = x(t) — x(t) be the error between the state and its estimate. 
We see that 

t) = (A-MC)e(t ). (2.28) 

Now if we assume that ( A , C) is an observable pair, then the spectrum of 
(A — MC) can be made arbitrary by a suitable choice of M. In particular, by 
a suitable choice of M , (A — AdC) can be made a stability matrix. Note that 
for the requirement of stability of the (A — MC), it is enough to assume that 
(A, C) is a detectable pair. 

Now consider a feedback control of the form 

u(t) = - Kx(t ), (2.29) 


giving us a closed loop system, 
dx 

— (t) = Ax(t) - BKx(t) = (A - BK)x(t) + BI<e(t). (2.30) 

By the pole-assignment theorem, the spectrum of (^4 — BK) can be made 
arbitrary by a suitable choice of K, provided (A, B) is a controllable pair 
(stabilizability is enough). 

Consider the pair of differential equations: 


d 

~x(t) 


A - BK 

BK 

'x(t) 

dt 

_e(t)_ 


0 

A-MC 

_ e (t)_ 


(2.31) 


It is clear that the spectrum of the above block matrix is determined by 
that of A — BK and A — MC and hence can be made arbitrary by proper 
choices of K and M and in particular can be made a stability matrix. This is 
one of the fundamental results of linear feedback control. 

We now turn to a discussion of quadratic-cost optimal control and show 
how this theory gives rise to optimal feedback controllers that render the 
closed loop system asymptotically stable. It turns out that the theory of con¬ 
trollability and observability plays an important role in the study of optimal 
control over an infinite time horizon. 
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3 Optimal control 


Consider the linear control system 

{ dx 

— (t) = Ax(t) + Bu(t ), #(s) = x , 

at 

y{t) = Cx{t) 


(3.1) 


on the time interval [s,T], 0 < s < T, where x is an arbitrary initial state 
in R”. The notation and terminology are the same as the ones defined in the 
section on controllability and observability. 

We shall be primarily concerned with the following optimal control prob¬ 
lem: to choose a control u(-) G L 2 (s, T ; R m ) that minimizes the cost functional 

J{u;s,x) = ^ J [(u{t),Ru(t)) + (x(t),Qx(t))]dt+^(x(T),Sx(T)), (3.2) 

where R = R* > 0, Q = Q* = C*C > 0, and S = S* > 0. A control 
u(-) minimizing J(u;x) will be called an optimal control. We shall not be 
concerned with the question of existence and uniqueness of solutions but with 
the characterization of the optimal control u(-) and the corresponding optimal 
trajectory £(■). 

Even though we are interested in solving the optimal control problem over 
a fixed interval [0, T] and for the fixed initial condition xq, it will turn out 
to be conceptually important to solve the problem for all initial points (s,x), 
0 < s < T. 

We shall also be interested in the infinite time problem: Find a control 
u(-) G L 2 (s, oo;R m ) that minimizes: 

1 f°° 

J(u;s,x) = - / [(u(t),Ru(t)) + (x(t),Qx(t))] dt. (3.3) 

^ J ft 


3.1 Finite time horizon 


We first discuss the finite time situation. We are interested in obtaining the op¬ 
timal control u(-) in feedback form u(t) = K(t)x(t), where K(t) G £(M";R m ). 
There are three basic approaches to the solution of this problem. The first is 
via the Calculus of Variations or equivalently the Maximum Principle and 
makes use of the adjoint equation. It can be shown that the optimal control 
is characterized by the solution of the following system: 


nx 

-it) = Ax{t) + Bu{t), 
at 

(3.4) 

x(s) = X, 


t) = —A*p(t) - Qx(t), 
at 

(3.5) 

P(T) = Sx(T), 
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Ru(t) + B*p(t) = 0 s < t <T. (3.6) 

We recognize this as a two-point boundary value problem. The system (3.4)- 
(3.6) can be decoupled as follows. It is here the idea of invariant embedding, 
namely, the idea of considering the optimal control problem for all initial (s, x) 
where 0 < s < T and x G 1" arbitrary becomes important. One first shows 
that the system of equations 


| -(i)=Am-BR~ 1 B*r 1 (t ), 

$(s) = x, 

^( t ) = -A* V (t)-Qm, 

v (T) = sar) 

admits a unique solution. We can then prove that the mapping 
* ~ (€(*),*?(*)) = R" - W(s,T;R n ) x W{s,T;R n ), 

where 

W(s,T;R n ) = j*: z G L 2 (s, T; R”), J G T 2 (s,T;R") 
is an affine continuous map and finally that the mapping 
x i—> rj(s) : R n —► R" is an affine mapping. 

From this it follows that we can write 

7/(s) = P{s)x + r(s), 

where 


(3.7) 


(3.8) 


(3.9) 


(3.10) 

(3.11) 

P(s) G £(R";R”) and r(s) G R". (3.12) 

Let (x(-),p(-)) be a solution of (3.4)-(3.6) in the interval [0,T]. Then 

P(t) = P(t)x(t) +r(t), Vt G [0,T], 
and a calculation shows that P(t) and r(t) satisfy: 
dP, 

■h\ -L ^l + \ -L P>( t \ A — Vl + \ H U ^ L->l + \ -\- f ) — l\ 

(3.13) 


, -(f) + A*Pit) + Pit)A - P(t)BR~ 1 B*P(t) + Q = 0, 

at 

P(T) = S, 


^(t) + A*r{t) - P(t)BR~ 1 B*r(t) = 0, 
at 

r(T) = 0. 


(3.14) 


Clearly r(t) is identically zero and standard results of ordinary differential 
equations prove that (3.12) has a unique global solution. 



32 


1-1 Control of Linear Differential Systems 


Therefore we have obtained the optimal control in feedback from: 
u(t) = —R~ 1 B*P{t)x{t). 

The same result can be obtained using the method of Dynamic Program¬ 
ming. Conceptually, the Calculus of Variations gives necessary conditions of 
optimality, whereas the method of Dynamic Programming gives sufficient con¬ 
ditions of optimality. But for the strictly convex quadratic cost problem, both 
methods give necessary and sufficient conditions of optimality. 

Let 

V (s, x) = inf J(u; s, x). 

U 

Then an application of the Principle of Optimality leads to the following 
partial differential equation for V : 

^(u(s),Ru(s)) + i(x(s),Qa;(s)) 

+ (V x V(x, s), Ax(s) + Bu(s )) 

[V(T,x) = (Sx,x), 

where X7 x V{x,s) is the gradient of V(x,s) with respect to the vector x. Car¬ 
rying out the minimization, we obtain 

u(s) =-R-iB^zVix^), Vs e [0, T], (3.16) 

Hence we obtain the so-called Bellman-Hamilton-Jacobi equation 

^-(s, x) + ± (V x V(x, s), BR^B^xVix, a)) 

+ ^(x,Qx) + (A*V x V(s,x),x) = 0. (3.17) 

Now, (3.17) can be solved by looking for a solution of the form: 

V ( s , x) = \ (x, P(s)x) + ( x , r(s)). (3.18) 

We can check that P(s) and r(s) satisfies (3.12) and (3.14) previously ob¬ 
tained, and we recover the same results as obtained by Calculus of Variation 
arguments. 

There is a third approach, in some sense related to the Dynamic Program¬ 
ming approach , to the solution of quadratic cost optimal control problems. 
This is the method of completing the squares. The main idea here is to observe 
that if 

— = Ax(t) + Bu(t), 

and if P(t) = P*(t) be such that dP/dt. exists in the interval [s,T], then 
defining 


(3.15) 


—— (s, x) + min 
os u 
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z(t.) 


u(t) 

x{t). 


and L(t) 


' 0 R~ 1 B* P(t) 

dP 

P(t)B —+A*P(t) + P(t)A 


we get 

f (z(t),L(t)z(t)) dt - (x(T),P(T)x(T)) + (x(s),P(s)x(s)) = 0. (3.19) 

J S 

Now let P(t) be the global solution on the interval [s,T] of the equation 

{ dP 

— (t) + A*P(t) + P(t)A - P(t)BR~ 1 B*P(t), +Q = 0, 2Q 

P(T) = S. 


Then adding the identity (3.20) to J(u; s , x) and doing some algebraic manip¬ 
ulations, we obtain 

J(u;s,x) = f \u(t) + R~ 1 B*P(t)x(t)\ 2 dt + (x(s), P(s)x(s)). (3.21) 

J S 

Hence the optimal control is given by 

u(t) = —R~ 1 B*P(t)x(t), (3.22) 

and the optimal cost V(s,x) by 

V(s, x) = (x, P(s)x). (3.23) 

In this book, we use the latter two methods in infinite dimensional situ¬ 
ations to obtain results on optimal control for the quadratic cost problem in 
a finite time interval. Apparently, one obtains more general results using this 
methodology. 

In Part IV, Chapters 1 to 3 develop the optimal control of parabolic, 
hyperbolic, and delay equations over a finite time interval. The observation 
operator is usually considered to be also bounded, but the case of unbounded 
observation operators is also treated. Chapter 2 deals with parabolic equations 
with unbounded control operators, whereas Chapter 3 deals with hyperbolic 
equations with unbounded control operators. The latter two chapters are the 
most technical, and the full power of the theory developed in Part II needs to 
be used. 


3.2 Infinite time horizon 

The study of the quadratic cost problem over a finite and an infinite time 
interval is essentially a study of the Riccati differential equation over the 
finite time interval [s, T\ 
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— (i) + A*P(t) + P(t)A - P(t)BR~ 1 B*P(t) + C*C = 0 (3.24) 

at 

subject to the terminal condition 

P(T) =P T > 0, (3.25) 

its asymptotic behavior and the corresponding matrix quadratic equation 

A*P + PA - PBR~ 1 B*P + C*C = 0. (3.26) 

The following theorem is proved (in certain infinite dimensional situations) in 
§2 of Chapter 1 in Part IV, and in §2 to §4 of Chapter 1 in Part V. 

Theorem 3.1. There exists a matrix P(t) satisfying the following: 

(i) P(-) is defined and belongs to C 1 ([s, T]; £(M")) and satisfies (3.24) and 
(3.25). 

(ii) P(t) > 0, s < t < T and is the unique solution of (3.24)-(3.25). 

(iii) Let K(t ) be a continuous function on [s,T], and let P(t) be the solution 
of the linear differential equation 

dP 

— (f) + {A- BK(t))*P(t) + P(t)(A - BK(t )) (3 2?) 

+ C*C + K(t)*RK(t) = 0, 

P(T) = P T > 0. (3.28) 

If P(t) is a solution to (3.24) and (3.25), then 

P(t)<P(t), s <t <T. 

(iv) Consider (3.24) with s —> —oo and T = 0. If ( A , B) is stabilizable, then 
P(t) is bounded on]— oo,0]. If (A,C) is detectable, then 

Poo = lim P(t) 


exists and is positive semi-definite. 

In that case, Poo is the unique positive semi-definite solution of (3.26) 
and 

A - BR~ 1 B*P 00 

is a stability matrix. 

The optimal control over the infinite time interval is then given by 

u(t) = —R~ 1 B*P ao x(t). (3.29) 

The study of these control problems when control is exercised through the 
boundary is most complicated for hyperbolic equations and is taken up in 
Chapter 3 of Part V. The study of exact controllability comes into the picture 
here to ensure that the space of admissible controls is nonempty. 
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4 A glimpse into i?°°-theory: state feedback case 

4.1 Introduction 

In many control problems the quadratic criterion is not the most appropriate. 
We consider a disturbance attenuation problem when the full state vector can 
be measured and introduce the so-called i/°°-optimal control problem. There 
is now a vast literature on this topic. For two textbook presentations, the 
reader is referred to T. Ba§AR and P. Bernhard [1] and B. A. Francis [1]. 
Consider the finite dimensional linear time-invariant system 

{ dx 

— 0 1) = Ax(t) + Lw(t) + Bu{t ), 
z(t ) = Cx(t) + Du(t), 

where u is interpreted as the controls and z as controlled outputs that are to 
be made small in the presence of exogenous disturbances w. The matrices and 
vectors have appropriate dimensions. 

Let S(A,B) denote the set of all constant gain stabilizing state feedback 
matrices. That is, 


S{A, B) = {K-. Re [A,; (A + BK)\ < 0}. 
Then for u £ S(A, B), the closed loop dynamics take the form 

{ dx 

— (t) = (A + BK)x(t) + Lw(t), 
z(t) = (C + DK)x(t), 

or in transfer function form 


(4.2) 


2(s) = Tk(s)w(s), 


where 

T K {s) = (C + DK)(sI-(A + BK))~ 1 L. 

The problem of //“-optimal state feedback is now stated as 


inf 

KeS(A,B) 


\\Tk\\h°°, 


where 

\\TkWhco = supcr max ||T(jw)|| 

UJ 

and (7 max denotes the maximum singular value of the matrix T(jco). 

This //“-optimal state feedback problem represents a special case of the 
more general //“- optimal output feedback disturbance rejection problem. 
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4.2 Main results 

The following assumptions are made on (4.1): 

(Al) The pair ( A , B) is stabilizable. 

(A2) The pair (A, C) is observable. 

(A3) D*[C D\ = [0 7]. 

(Al) is necessary for the stabilization of (4.1). Assumption (A2) is a tech¬ 
nical assumption that guarantees the invertibility of certain algebraic Riccati 
equation solutions. The orthogonality assumption (A3) is analogous to no 
cross weighting between the state and control in the standard LQ problem. 
In case (A3) is violated, the change of control variables from u to v given by 

u(t) = (D*D)~ 1 / 2 v(t) - (D* D)~ 1 Cx(t) 

yields a new system that satisfies (A3). Furthermore, it can be shown that a 
controlled output of the form 

z(t) = Cx(t) + Du(t ) + Eu(t) 

may be transformed to the form of (4.1). Thus, (A3) is made with minimal 
loss of generality. 

The main result is now stated. 

Theorem 4.1. Consider the linear system (4.1) under assumptions (Al) 
to (A3). Under these conditions, there exists a K £ S(A,B) such that 
\\Tk Hffoo < 7 if and only if there exists an X = X* > 0 that satisfies 

XA + A*X + C*C + x(^LL*-BB*'jx = 0 (4.3) 

with A + (l/y 2 LL* — BB*)X stable (i.e., all eigenvalues in the open left-half 
complex plane). 

The remainder of this section is devoted to the proof of Theorem 4.1 for 7 = 1 . 
By linearity, this simplification is made without loss of generality. 

First, some preliminary results from linear quadratic optimization theory 
are stated for the linear system 

! dx 

-X(tf = Ax(t) + Bu(t), x(0) = x 0 , 
y(t ) = Cx(t). 

Lemma 4.1. Let (A, B) be stabilizable and (A, C) detectable ( resp. observ¬ 
able). Then there exists a unique P = P* > 0 (resp. > 0) that satisfies 


PA + A*P + C*C - PBB*P = 0, 
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with A — BB*P stable. Furthermore, the state feedback control law u(t) = 
—B*Px{t) is a minimizing solution for the problem 

1 r°° 

infx / (\y{t)\ 2 + \u{t)\ 2 ) dt. 

u z j o 

This is Theorem 3.1 restated. 

Lemma 4.2. Let G(s) = C(sl — A)~ 1 B with A stable. Then ||G||oo < 1 if 
and only if there exists an X = X* > 0 that satisfies 

XA + A*X + C*C + XBB*X = 0 

with A + BB*X stable. Furthermore, the state feedback u(t) = BB*Xx{t) 
solves 

1 f°° 

sup-/ {\y(t)\ 2 -\u{t)f)dt. 

u £ J o 

For a proof of the above lemma see J. C. Willems [1]. 

The proof of Theorem 4.1 is now presented. To prove the “if” direction, 
assume that X = X* > 0 satisfies (4.3) with A + ( LL* — BB*)X stable. A 
manipulation of (4.3) yields 

X(A - BB*X) + {A- BB*X)*X 

+ (C - DB*X)*(C - DB*X ) + XLL*X = 0. (4.4) 

Now assumptions (A2) to (A3) imply that the pair (A — BB*X, C — DB*X) 
is observable. This observability, (4.4), and X > 0 together imply that the 
matrix A—BB*X is stable via standard Lyapunov stability theory. Thus, K = 
—B*X € S(A, B). Finally, using (4.4) and the stability of A + {LL* — BB*)X 
in Lemma 4.2 implies that ||Tx||h~ < 1 , which is the desired result. 

To prove the “only if” direction requires the following preliminary result: 

Lemma 4.3. There exists an X = X* > 0 that satisfies 

XA + A*X + C*C + X(LL* ~ BB*)X = 0 (4.5) 

with A + {LL* — BB*)X stable if and only if there exists a P = P* > 0 that 
satisfies 

AP + PA* + PC*CP + LL* - BB* = 0 (4.6) 

with —A * — C*CP stable. 

Proof. Let P = A -1 . This establishes an equivalence of the existence of pos¬ 
itive definite solutions to either (4.5) or (4.6). To show equivalence of the 
stability conditions, a manipulation of either (4.5) or (4.6) yields the similar¬ 
ity condition 


A + {LL* - BB*)X = P{—A* - C*CP)P~ 1 . 


□ 
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Thus to prove the “only if” portion of Theorem 4.1, it suffices to prove 
the equivalent condition associated with (4.6). 

Toward this end, let K £ S(A,B) be such that ||Tiy||#oo < 1. Then from 
Lemma 4.2, there exists an X = X* > 0 that satisfies 

X{A + BK) + (A + BK)*X + {C + DK)*(C + DI<) + XLL*X = 0, (4.7) 

with A + BK + LL*X stable. A straightforward manipulation of (4.7) yields 

XA + A*X + C*C + X(LL* - BB*)X = -{K + B*X)*{K + B*X). (4.8) 

Let P = X- 1 . Note that assumptions (A2)-(A3) imply observability of the 
pair (A + BK,C + DK ), which in turn implies X > 0, thus allowing the 
inversion of X. In terms of P, (4.8) now takes the form 

AP + PA* + PC*CP + LL* — BB* = —V*V, (4.9) 


where 


V = KP + B*. 


Now (4.9) is not quite in the desired form of (4.6). Thus, as in J. C. Willems [1], 
let AP = P — P. Then subtracting (4.9) from (4.6) yields (after some straight¬ 
forward manipulations) 


(■ -A)*AP + AP(-A) + V*V - APC*CAP = 0, (4.10) 


where A = A* + C*CP. Clearly, if one can find a symmetric positive semi- 
definite solution, AP, to (4.10), then P = P + AP satisfies the desired 
(4.6). However, (4.6) is of the form of a standard LQ Riccati equation as 
in Lemma 4.1. The requisite stabilizability and detectability in Lemma 4.1 is 
now shown as follows: 

1 . The matrix pair (—A,C*) is controllable. This follows directly from as¬ 
sumption (A2) and that — A = —A* — C*CP. 

2. The matrix pair {—A, V) is detectable. To see this, a straightforward ma¬ 
nipulation of (4.9) yields the similarity condition 

-A - K*V = P{A + BK + LL*X)P~ 1 . 

However, recall that X is such that A+BK+LL*X is stable, thus proving 
the desired detectability. 

These observations along with Lemma 4.1 guarantee the existence and 
uniqueness of a positive definite AP, which satisfies (4.10). Thus, P = 
P + AP > 0 and satisfies (4.6). 

It then remains to be shown that — A * — C*CP is stable. However, from 
Lemma 4.1, one has that —A — C*CAP is stable. But 


-A - C*CAP = -A* - C*CP, 



5 Dissipative systems 


39 


which, via Lemma 4.3, completes the proof. 

It is worthwhile remarking that the current proof exploits the fact that 
the condition ||Tr-|| < 1 is a characterization of dissipativity in terms of scat¬ 
tering variables. It is well known that the dissipative property in turn can 
be characterized in terms of a quadratic Lyapunov function obtained from 
an indefinite quadratic cost problem (cf. Lemma 4.2). The exposition here 
essentially exploits these ideas to obtain the desired result. We have included 
a section on dissipative systems for this reason. 

It should be remarked that the state space theory of H°° should only be 
considered as a computational device and not as a substitute for the operator 
theory solution of _ff°°-problems. The important questions of approximation 
and robustness should be treated from the input-output viewpoint, and it is 
unclear whether it is meaningful in the state space description. 

The general case, when only measurement feedback is available, was 
treated in the important paper of J. C. Doyle, K. Glover, P. P. Khar- 
GONEKAR, and B. A. Francis [1] in 1989. These results were generalized to 
certain Infinite Dimensional Systems (the so-called Pritchard -Salamon sys¬ 
tems) by B. VAN Keulen [1] in 1993. The new element here is that the 
feedback solution is determined in terms of two coupled Ricatti equations. 


5 Dissipative systems 


5.1 Definitions and preliminary results 


Consider the linear, stationary dynamical system 

dx 

— = Ax + Bu , a;(0) = xq, 

at 

y = Cx + Du, 


(5.1) 


where x £ R”, u £ R m , y £ R p , and A, B , C, D are constant matrices of 
dimensions (nxn), (nx m) , ( pxn ), and ( pxm ), respectively. We shall assume 
that the input functions 1 1 —> u(t) : R —> R m are locally square integrable. 

Given x(t o) = Xo £ R n , there exists a unique absolutely continuous func¬ 
tion t i—> x(t) : [to,oo) —> R” that satisfies (5.1) almost everywhere. Corre¬ 
spondingly, the output function t i—> y(t) : [fo,oo) —> R" is locally square 
integrable and the state trajectory t i—> x{t) : [to>oo) ~> R n is also locally 
square integrable. In terms of the above, we denote the input space by U and 
the output space by y. 

We make the assumption that (5.1) is reachable (and controllable) and 
observable. Hence, the realization of the input-output map 

y(t) = Ce A{t ~ to) x 0 + I Ce A(t ~ T) Bu{T)dT + Du(t) 

Jt o 


(5.2) 
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given by (5.1) is minimal. 

In the sequel, we wish to examine the dissipativeness of system (5.1) with 
respect to the supply rate w = ( u , y) = u* y, where we are assuming that 
m = p and (•, •) represents the scalar product on R". 

Definition 5.1. A function S : R” — > R + is called a storage function. The 
system (5.1) is said to be dissipative with respect to the supply rate w(t) = 
(u(t),y(t)) if there exists a storage function S : R" —> R + such that for all 
Xq £ R™ and u £U, the dissipation inequality 


r l i 


(u(t),y(t))dt > S(x(tx)) 


S(x 0 ) 

holds for all t\ > to in 

rti 

x ( tl ) = e A ^~ to) x 0 + / e A(tl " T) Bu{t) dr 

Jtn 


J to 
where 


and 


(5.3) 

(5.4) 

(5.5) 


y{t)=Ce A<yt ^xq + / e A ^ ^Bu(r) dr + Du(t). 

Jt 0 

Note that if S is smooth, then the dissipation inequality may be written as 


S(x) > 0, 

( VS(x ), Ax + Bu ) < (u, Cx ) + (u, Du) , 


(5.6) 


VieR", and u G R m . □ 

The form of (5.6) (note the similarity to the Hamilton-Jacobi equation) sug¬ 
gests that the identification of storage functions arises by defining appropriate 
variational problems associated with (5.1). We start with the following lemma 
(J. C. Willems [1, Lemma 1]). 

Lemma 5.1. Let the dynamical system defined by (5.1) be minimal and dis¬ 
sipative with respect to the supply rate w(t) = ( u(t),y(t )). Let S be a storage 
function. Then there exists an e > 0 such that 

S(x) > 5'(0)+e||a:|| 2 , VieR". 


5.2 Associated variational problems 

Now, define the following variational problems: 

S a (x o) = - Inn inf [ (u(t),y(t)) dt, (5.7) 

J Q 

S r {x o) = — lim inf [ (u(t),y(t)) dt, (5.8) 

t-i—’> — oouGU Jt_ 
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subject to the constraint (5.1) and the boundary conditions x(t- 1 ) = 0, x(0) = 
xq. We adopt the normalization min^ggn S{x) = S'(O) = 0. S a is referred to 
as the available storage and S r the required supply. Note that (5.7) and (5.8) 
are quadratic variational problems, but they may be singular when D + D *, 
which is nonnegative from dissipativity, is singular, and an optimal control 
may not exist even though the desired infimum exists. 

The variational problems characterizing the available storage and required 
supply may then be solved by considering appropriate solutions of the alge¬ 
braic Riccati equation: 

KA + A*I< + {KB - C*){D + D*y 1 {B*K - C) = 0. (5.9) 

Theorem 5.1 (J. C. Willems [2]). The algebraic Riccati equation (5.9) 
has a negative definite solution if and only if (5.1) is dissipative with re¬ 
spect to the supply rate vu = {u,y). In that case, there exists only one 
real symmetric solution K~ with the property ReA(^4“) < 0, where A~ = 
A-\-B{D+D*)~ 1 {B* K~C), and only one real symmetric solution K + with the 
property A(A+) > 0, where A + = A~ + {KB — C*){D + D*)~ 1 B*. Moreover, 
0 < K~ < K + and every real symmetric solution satisfies K< K < K + . 
Hence, all real symmetric solution are positive definite, A(^4“) < 0, and 
A(T+) > 0. 

Theorem 5.2. Under the assumptions of Theorem 5.1, 

S a {x) = ~{x,K~x) and S r {x) = ~{x,K + x). 

Proof. Let us first consider the case when D + D* is nonsingular. Let I\ be a 
real symmetric solution of the algebraic Riccati equation (5.9). Then 

jU' K x) 

along the trajectories of x = Ax + Bu is given by 
{u, Cx + Du) 

- i(u — {D + D*)~\B*K - C)x, {D + D*){u - {D + D*)*{B*K - C)x). 
Now assume that u £ U, transfers Xq at to to x± at t\. Then 


{xi,Kxi) - {xq,Kx q ) 


= 2 


( u{t),y{t))dt 


'to 


rti 

/ (u — {D + D*)~ 1 {B* K — C)x, 

{D + D*){u 


{D + D*)~ 1 {B*K -C)x) dt. 
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Let us put to = 0 and K = K in the above, and noting that K > 0, we 
obtain 

(■ u(t),y{t))dt < x 0 ,K~x 0 ), 

Hence, S^xo) < 5 ( 0 : 0 , K~xq). Now consider the control 
u = (D + D*)~ 1 (B*K~ - C)x. 

The closed loop system is then x = A~x, and because ReA(A _ ) < 0, 

lim x(t) = 0 . 



Hence, along this trajectory, 

1 
2 

and hence, S a (x 0 ) = ^(xo, K~Xq)- A similar argument shows that 

S r (x Q ) = 7 }( x 0 , K + x 0 ). 


(xo,K x 0 ) 


(u(t),y(t))dt = 0, 


We now look at the case when D + D* is singular. The idea is to replace D 
by (D + 1 1), where I is the identity matrix. It is clear that the new dynamical 
system with D replaced by (D + 1 1) is also dissipative with respect to w = 
(u,y). We now proceed to prove the result through a limiting argument by 
considering 



Therefore, consider the algebraic Riccati equation (5.9) with D+e/21 in place 
of D 


K e A + A*K e + ( K e B - C*)(D + D* + eI)~ 1 {B*K e - C*) = 0 

and consider the real symmetric solutions K~ and Kf with the properties 
ReA(A“) < 0 and ReA(A+) > 0, with A~ and A+ defined analogously as in 
Theorem 5.2. We then have 0 < K~ < A'+ and all real symmetric solutions 
K e satisfy K~ < K e < Kf. Indeed, we have K~ < Kf and ReA(A“) < 0 
and Re A(A+) > 0. Now define 

K~ = lim K~ and K + = lim K j". 

efO efO 

Then, Theorem 5.2 holds for K~ and I( + so defined. To see this, note that K~ 
and Kf are monotone nondecreasing, and hence, the limit K = lim e ^o K e 
and K + = lim £ |o AA exist. 

Now we have 
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Sa( x ) = ( x > K e x) and Sf(x) = (x, K+x). 

We need to prove that S e a and S e r are continuous functions of s, e > 0. 
Consider S%(x o) and assume that 

limS*(xo) ± S e a °{x 0 ). 

Now S%(x o) is a monotone nonincreasing function of e. Hence, 

limS^xo) < S e a °{x 0 ). 

ele 0 

By the definition of S%°(xo), it follows that there exists a it £ U and t\ > 0, 
such that t 

lim Sa(xo) < — [ ( u(t),y{t))dt , 
slso Jo 

with x = Ax + Bu, y = Cx + {D + £q/2I)u and x(0) = xo- Now, for fixed u 
and t\ and for all e, £o < £ < e + 6, 

(' u(t),y(t))dt , 

with constraints x = Ax + Bu, y = Cx + (D + £q/2 I)u and x(0) = xo, is a 
continuous function of e, which contradicts the inequality 

lim^(xo) < <5^°(xo). 

Hence, S e a [x o) is a right continuous function of e, and hence, ^(x,K~x) = 
S a (x). In a similar manner, we can prove S r (x) = \{x, K + x). Hence, we have 
proved that Theorem 5.1 remains true when D + D* is singular. □ 

Remark 5.1. Note that when D + D* is singular, the optimal control may not 
exist. □ 



5.3 Quadratic storage functions 


Given a linear, stationary setting, it is natural to consider storage functions 
that are quadratic, |(x, Qx), Q = Q*. The following theorem follows easily 
from Theorem 5.2. 


Theorem 5.3. The stationary minimal linear dynamical system given by 
(5.1) is dissipative with respect to the supply rate w = ( u, y) if and only if 
the matrix inequalities 


A*Q + QA QB-C* 

B*Q — C -D-D*\ ~ ’ 

Q = Q*> 0, 


(5.10) 

(5.11) 


have a solution. The function ^(x,Qx) is a storage function if and only if 
Q satisfies (5.10) and (5.11). Consequently K~ and K + , as defined earlier, 
satisfy these inequalities and 0 < K~ < Q < K + . 
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Recent research on the synthesis of controllers using linear matrix inequal¬ 
ities and semi-definite programming (see, for example, the recent book of 
S. Boyd and L. Vandenberghe [1]) is related to the ideas presented here. 


6 Final remarks 


If one were to write another volume it should be concerned with a generaliza¬ 
tion of the following finite dimensional problem to infinite dimensions: 

inf J w(x(t),u(t)) dt, (6.1) 

where w(x, u ) = ^[(a;, Qx ) + ( u , Ru) + 2(u, Cx)], R = R* > 0, and Q = Q* but 
without any definiteness condition on Q, subject to the dynamical constraint 


dx 

dt 

a;(s) 


= Ax(t) + Bu(t), 
= x 


( 6 . 2 ) 


and the related infinite time problem 

/ OO 

w(x{t),u(t)) dt (6.3) 

with the dynamical constraint (6.2) and final value conditions x(oo) = 0 or 
x(oo) = free. 

A variety of problems such as linear quadratic differential games, the 
Kalman-Yacubovich-Popov lemma of stability theory, and H 00 -theory (in 
state space form) is related to this topic. 


Notes 

The results of this chapter are for the most part classical. The concepts of con¬ 
trollability and observability were introduced by R. E. Kalman [1, 3], where 
the criteria of controllability and observability and the structure theorem were 
developed. In this connection, see also the early paper of E. Gilbert [1], The 
minimum energy control for transfer from the origin to a final state was first 
discussed in R. E. Kalman, Y. C. Ho, and K. S. Narendra [1], For a 
textbook study of these questions as well as a treatment of stability theory, 
see R. W. Brockett [1], The concepts of stabilizability and detectability 
were introduced by Wonham in his study of the algebraic Riccati equation 
(cf. W. M. Wonham [2]). The criteria for stabilizability and detectability 
are due to M. L. J. Hautus [1]. The pole-assignment theorem in the real 
case was proved by W. M. Wonham [1] and independently by J. D. Simon 
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and S. K. Mitter [1], The proof presented here follows W. M. Wonham [3]. 
Theorem 2.6 is due to J. Zabczyk [3]. The idea of a state estimator was first 
introduced by D. G. Luenberger [1], For the treatment of compensators for 
linear systems as estimator-controller and the use of the pole-assignment theo¬ 
rem in this context, see J. D. Simon and S. K. Mitter [1], For a discussion of 
the quadratic cost optimal control problem, see the book by R. W. Brock- 
ett [1] where the completing the square argument is developed. The idea 
of invariant embedding used in §3.1 is due to R. Bellman [1]. Its use in 
decoupling the Hamiltonian equations in the form described here is due to 
J. L. Lions [3]. It was formally used in the same way by S. K. Mitter [1], 
Theorem 3.1 is due to W. M. Wonham [1] (under the slightly stronger hy¬ 
pothesis of observability). The results of §4 follow an unpublished manuscript 
of S. K. Mitter and J. S. Shamma [1] but are essentially an application 
of the results given in the paper of J. C. Willems [1]. There is now a vast 
literature on the so-called iJ°°-approach to the control of linear systems. For 
textbook presentations, see T. Ba§ar and P. Bernhard [1], B. A. Fran¬ 
cis [1], and B. van Keulen [1], 
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Linear Quadratic Two-Person Zero-Sum 
Differential Games 


1 Introduction 

In this chapter we broaden the general perspective of the book and consider 
two-player zero-sum games with linear dynamics and a quadratic utility func¬ 
tion over a finite time horizon. They can be viewed as a natural extension of 
the single player linear quadratic optimal control problem. In particular they 
illustrate the occurrence of symmetrical solutions to the matrix Riccati differ¬ 
ential equation that are not necessarily positive semi-definite. It also connects 
with the glimpse of 7/ 00 -theory given in the previous chapter. 

Since Game Theory arises from a different context than the one in Control 
Theory, we quickly review some background and terminology. For instance, 
the notion of utility function has a long history. Gabriel Cramer [1] (1728) 
and then Daniel Bernouilli [2] (1738) first proposed as a decision crite¬ 
rion the maximization of expected utility rather than of expected wealth. 
Daniel Bernouilli introduced as utility function, the log, to resolve the St. Pe- 
tersberg Paradox (Risk Aversion) in 1760. Much later, in an appendix to their 
classic work, J. von Neumann and O. Morgenstern [1] (1943) set out for 
the first time an axiomatic justification for this criterion. 

We consider two players (most definitions will carry over to N players). In 
a static game, there is only one shot; that is, the game is played only once. 
Player 1 decides a value v\, which can be a vector, a real number, or a discrete 
variable. Similarly, Player 2 decides V 2 - Each of them has a utility function 

Ci(v i,v 2 ), i = 1,2, 

that he/she wants to minimize. A Cournot-Nash equilibrium (cf. A. Cour¬ 
not [1] in 1838 and J. Nash [1] in 1950 1 ) is a pair (Di,^) such that 


1 The concept of the Nash equilibrium is not exactly original to John F. Nash. 
Antoine Augustin Cournot showed how to find what we now call the Nash equi¬ 
librium of the Cournot duopoly game. Consequently, some authors refer to it as 




48 


1-2 Linear Quadratic Two-Person Zero-Sum Differential Games 


Ci { vuV 2 )< Ci { vi , Vz ), Vui G Ul d , 

C 2 {vi,v 2 ) < C 2 {vi,v 2 ), Vv 2 €U^ d , 

where U\ d and Uf d represent the sets of constraints for both players. 
In a two-person zero-sum game, one has 


Ci(vi,v 2 ) = C{v i,v 2 ), 

C 2 ( V !, V 2 ) = -C(v i,v 2 ). 

So there is in fact only one functional, C(vi,v 2 ). Player 1 wants to minimize 
it, and player 2 wants to maximize it. It is a noncooperative game. A Nash 
equilibrium satisfies the condition 


C(v!,v 2 ) < C(vi,v 2 ) < C(v 1 , t> 2 ), Vui G Ul d and Vu 2 G U 2 ad . 

In this context the pair (vi,v 2 ) is called a saddle point and C(vi,v 2 ) the value 
of the game. The existence of a saddle point is not so common for games. In 
general, the so-called lower and upper values are different 

sup inf C(vi,v 2 ) < inf sup C (tq ,v 2 ), 

V 2 Vl Vl V2 

and they can respectively be — oo and +oo. 

In this chapter we study the dynamical version on a finite time horizon 
of the static zero-sum two-player game by introducing a time-dependent state 
vector whose dynamics are governed by a system of linear differential equa¬ 
tions. At that level there are open loop and closed loop strategies for the 
players and sometimes an imperfect knowledge of the state. We shall restrict 
ourselves to the open loop case and a perfect knowledge of the state. In that 
context, the Min Sup problem was studied in 1969 by M. C. Delfour and 
S. K. Mitter [1], The fundamental theory of closed loop two-player zero-sum 
LQ games was given in 1979 by P. Bernhard [2] followed by the seminal 
book of T. Ba§ar and P. Bernhard [1] in 1991 and 1995 that covered 
the 7/°°-theory. The very nice work by P. Zhang [1] in 2005 established the 
equivalence between the finiteness of the open loop value of a two-player zero- 
sum LQ game and the finiteness of its open loop lower and upper values. It 
means that the duality gap , that is the difference between the upper and the 
lower values of the game, is either 0 or +oo. The reader is referred to the 
above references for a detailed bibliography of the vast and rich literature on 
dynamical games. 


a Nash-Cournot equilibrium. However, Nash showed for the first time in his dis¬ 
sertation, Non-cooperative games (1950), that Nash equilibria must exist for all 
finite games with any number of players. Until Nash, this had only been proved 
for two-player zero-sum games by John von Neumann and Oskar Morgenstern [1] 
(2nd edition, 1947). 
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This new chapter is self-contained with mathematical proofs. Section 2 
gives the definitions, notation, properties, semi-derivatives, and convexity/con- 
cavity characterizations of the utility function. 

Section 3 gives necessary and sufficient conditions for the existence of a 
saddle point of the game and introduces the coupled system that will also 
arise in the characterization of the open loop lower and upper values of the 
game. This will later be completed in Theorem 5.1 in §5 with the equivalent 
condition that the value i>(:ro) of the game is finite. 

Section 4 is devoted to the case where the open loop lower value is finite. 
By duality this also covers the case where the open loop upper value is finite. 
It emphasizes the role of the feasibility condition. 

Section 5 combines the results of §4 to characterize the finiteness of the 
open loop value of the game, and Theorem 5.1 shows its equivalence with the 
existence of an open loop saddle point, completing the results of Theorem 3.1 
in §3. It also includes the equivalence between the finiteness of the upper and 
lower values and the finiteness of the value of P. Zhang [1]. Therefore, in the 
linear-quadratic case, the duality gap is always zero or infinite. 

Section 6 constructs the associated Riccati differential equation in the 
open loop saddle point case via invariant embedding with respect to the ini¬ 
tial time. It is also shown that under the assumption of an open loop saddle 
point in the time horizon [0, T] for all initial states, there is an open loop sad¬ 
dle point in the time horizon [s, T\ for all s, 0 < s < T, and all initial states 
(Theorem 6.3 (iii)). From this we get an optimality principle and adapt the 
invariant embedding approach of R. Bellman in the style of J. L. Lions [3] 
to construct the decoupling symmetrical matrix function P(s) and show that 
it is an H 1 ( 0,T) solution of the matrix Riccati differential equation. Thence 
an open loop saddle point in [0,T] yields closed loop optimal strategies for 
both players that achieves a closed loop-closed loop saddle point in the sense of 
P. Bernhard [2]. Furthermore, a necessary and sufficient set of conditions for 
the existence of an open loop saddle point in [0, T] is the convexity-concavity 
of the utility function and the existence of an U 1 (0,T) solution to the matrix 
Riccati differential equation. This leaves the cases where either the open loop 
lower value is —oo or the open loop upper value is = +oo. Two informative ex¬ 
amples of solutions to the matrix Riccati differential equation where the open 
loop saddle point does not exist are worked out, even when the solution of the 
Riccati differential equation is strictly positive and infinitely differentiable. 
A third example is given where the solution of the Riccati differential equa¬ 
tion is infinitely differentiable and strictly positive and the open loop lower 
and upper values are +oo. The chapter also briefly discusses the open/close 
loop upper/lower value of the game and generalized solutions of the Riccati 
differential equation. 

This chapter is an expanded version of M. C. Delfour [16]. 
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2 Definitions, notation, and preliminary results 


2.1 System, utility function, and values of the game 

Given a finite dimensional Euclidean space of dimension d > 1, the norm 
and inner product will be denoted by |x| and x-y , respectively and irrespective 
of the dimension d of the space. Given T > 0, the norm and inner product in 
L 2 (0, T;R") will be denoted II/II and (f,g). The norm in the Sobolev space 
0,T;R”) will be written ||/|| H i. 

Consider the following two-player zero-sum game over the finite time in¬ 
terval [0,T] characterized by the quadratic utility function 

f T 

C Xo (u, v) d = Fx(T) • x(T) + / Q(t)x(t) - x(t)+ \u(t)\ 2 -\v(t)\ 2 dt, (2.1) 

Jo 

where x is the solution of the linear differential system, the so-called state 
equation 


-^(t) = A(t)x(t) + B 1 (t)u(t) + B 2 (t)v(t) a.e. in [0,T], x(0) = xo, (2.2) 

xq is the initial state at time t = 0, u € L 2 (0,T;R m ), m > 1, is the strategy 
of the first player, and v € L 2 (0,T;R fc ), k > 1, is the strategy of the second 
player. We assume that F is an n x n-matrix and that A, B\, B 2 , and Q 
are matrix-functions of appropriate order that are measurable and bounded 
almost everywhere in [0,T]. Moreover Q(t) and F are symmetrical (but not 
necessarily positive semi-definite). The above assumptions on F, A, Bi, B 2 , 
and Q will be used throughout this chapter. 

It will be convenient to use the following compact notation and drop the 
a.e. in [0, T] wherever no confusion arises 


C XQ (u, v) d = Fx(T) ■ x(T) + f Qx ■ x + \u\ 2 — \v\ 2 dt 

Jo 


and 

x' = Ax + B\u + B 2 v a.e. in [0,T], x(0) = xo- (2-3) 

Remark 2.1. The following more general quadratic structure involving cross 
terms: 


[ T 

~Q S T ' 


X 

c x 0 (u, v) d = Fx(T) • x(T) + / (x, u, v) • 

S* Ni 0 


u 

Jo 

£ 

o 

* 

E*h 


V 


dt, (2.4) 


can be brought back to the above form by the folllowing change of variables 


X 


1 

o 

o 

1_ 


X 

u 

= 

-N^S* N7 l/2 0 


u 

V 


1 

nf 

* 

o 

lo 

i_ 


V 


(2.5) 
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where the new matrix functions IVi, IV 2 , S , and T are all assumed to be mea¬ 
surable and bounded and N x (t) and N 2 (t) are symmetrical positive definite 
matrices such that 

3isi > 0 such that Vu € R m and almost all t, N x (t)u ■ u>v 1 \u\ 2 , 

3r / 2 > 0 such that Vu € and almost all t , N 2 (t)v ■ v > v 2 |z;| 2 . 


This yields 

Fx{T) ■ x(T) + [ [Q- SN X X S* + TN^T*] x-x+ \u\ 2 - |u | 2 dt 

J 0 

and the system 

x' = Ax + B 1 (-N~ 1 S*x + N~ 1/2 u) + B 2 {N^T*x + N~ l/2 v ) 

= (A - BiN^ 1 S* + B 2 N^T*)x + B x N x 1/2 u + B 2 N~ 1/2 v. 


By introducing the new matrices 


Q = Q- SN-\S* + TN.- l T*, 

A= A - BiN^ 1 S* + B 2 N^T*, 

B x = B X N~ XI \ B 2 = B 2 N~ 1/2 , 
we are back to the simpler initial structure 

[ T — 

C Xo (u, v) = f Fx(T) ■ x(T) + / Qx ■ x+ \u\ 2 — \v\ 2 dt, 

Jo 

j x' = Ax + B x u + B 2 v, 

\ x(0) = Xq . 

It is readily seen that 


inf sup 

u£L 2 (0,T-,R m ) V £L 2 (0,T-,R k ) 

sup inf 

v£L 2 (0,T;R k ) veL 2 (0,T;R m ) 


C x 0 (U,V) 
C Xo (u,v ) 


inf sup C x „(u,v), 

■ue£ 2 (0,T;R m ) S6 i2( 0iT;R f=) 

sup inf C Xn (u,v). 

v£L 2 (0,T;R k ) «ei 2 (0,T;R m ) 


For the Ff°°-theory, N x (t) = I and N 2 (t) = y 2 /, where 7 7 ^ 0 and / is the 
identity matrix. As for the classical optimal minimizing control problem, it 
can be recovred by choosing N 2 (t) = I and B 2 (t) = 0. □ 

We shall also study the existence of a symmetrical solution to the associ¬ 
ated matrix Riccati differential equation 

P' + PA + A*P-PRP+Q = 0 a.e. in [0,T], P{T) = F, (2.7) 


where R = B X B\ — B 2 B 2 , in relation with the following objectives of the 
game. 
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Definition 2.1. Let Xq be an initial state in R™ at time t = 0. 

(i) The game is said to achieve its open loop lower value (resp. upper value) 
if 


v (a?o) = f sup inf C Xo (u,v ) 

„eL2(o.T;R*)«^ 2 (°- T ; Rm ) 


def 


(resp. u + (xo) == inf 

uSL 2 (0.T;I 


sup C Xo (u,v)) 

1 v£L 2 (0.T;R k ) 


( 2 . 8 ) 

(2.9) 


is finite. By definition u _ (a;o) < u + (a;o). 

(ii) The game is said to achieve its open loop value if its open loop lower 
value u _ (a;o) and upper value u + (a;o) are finite and 

v~(x 0 ) = v + (x 0 ). ( 2 - 10 ) 

The open loop value of the game will be denoted by v(xq). 

(iii) A pair (u,v) in L 2 (0, T;R m ) x L 2 (0,T;R fc ) is an open loop saddle point 
of C Xo (u,v) in L 2 (0, T ; R m ) x L 2 (0, T ; R fc ) if for all u in L 2 (0,T;R m ) and 
all v in L 2 (0, T ; R fe ) 


C Xo (u,v) < C Xo (u,v) < C Xo (u,v). (2-11) 

□ 


In general, (ii) does not necessarily imply (iii), but we shall see that it does 
for linear-quadratic games. 


Definition 2.2. Associate with xq £ R" the sets and the functions 


V(x 0 ) d = { v G L 2 (0, T; R fe ) : inf C Xo (u, v) >- 

' ueL 2 (0,T;R m ) 


U(xo) = f i u € T 2 (0, T; R m ) : sup C Xo (u, v) < +oo ^ , 

[ v€L 2 (0,T-m. k ) J 

4»= C X0 ( u , y ), J+(w) d = sup C X0 {u,v). 

mSL 2 (0,T;R ) veL 2 (0,T;R k ) 


( 2 . 12 ) 

(2.13) 

(2.14) 


□ 


By definition, V(xo) 7 ^ 0 if and only if v~(xo) > —00 and U(x 0 ) ^ 0 if and 
only if v + (xo) < + 00 . In this chapter we only consider the open loop case. 
Corresponding definitions can be given in the closed loop case, and the reader 
is referred to P. Bernhard [2] and T. Ba§ar and P. Bernhard [1], 


2.2 Properties, semi-derivatives, and convexity/concavity of 
Cx 0 ( M ? ^ ) 

The functional C Xo (u, v) is infinitely differentiable, and since it is quadratic, 
its Hessian of second order derivatives is independent of the point (u, v). More 
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precisely 2 

\d,C Xo (u, v; u, v) = Fx(T) ■ y(T) + (Qx, y) + (u, u) - (v, v), (2.15) 

where x is the solution of (2.3) and y is the solution of 

y = Ay + B\u + B 2 v, y(0) = 0. (2-16) 

It is customary to introduce the adjoint state equation 

p' + A* p + Qx = 0, p(T) = Fx(T) (2.17) 

and rewrite (2.15) for the gradient in the following form: 

\dC XQ (it, v; u, v) = (Bip + it, u) + (B^p — v,v). (2-18) 

As predicted, the Hessian is independent of (u, v): 

±d 2 C Xo (u,v;u,v;u,v) = Fy(T) ■ y(T) + ( Qy,y ) + (u,u) - (v,v), (2.19) 

where y is the solution of (2.16) and y is the solution of 

y’ = Ay + B\u + B^v, y(0) = 0. (2.20) 


In particular, for all xo, u, v, u, and v 

d 2 C Xo (u,v;u,v;u,v) = 2C 0 (u,v), (2-21) 


and this yields the following characterizations of the u-convexity, v-concavity, 
and (it, i>)-convexity-concavity. 

Lemma 2.1. The following statements are equivalent: 

(i) the map u i—> Co (it, 0) : L 2 (0,T;R m ) —> R is convex; 

(ii) for all it £ L 2 (0,T;R m ) , Co(it,0) > 0; 

2 Given a real function / defined on a Banach space B, the first directional semi¬ 
derivative at x in the direction v (when it exists) is defined as 


df(x;v) *= f lim / (a; + tv ) ~ f( x ) 
J x J t\, o t 


When the map v h-> df(x; v) : B —> R is linear and continuous, it defines the 
gradient V/( x) as an element of the dual B* of B. The second order bidirectional 
derivative at x in the directions (v, w) (when it exists) is defined as 


d 2 f(x; v, w) = f lim 
’ ' t\,o 


df(x + tw; v) — df(x; v) 
t 


When the map (v, w) i—> d 2 f(x; v, w) : B x B —> R is bilinear and continuous, it 
defines the Hessian operator Hf(x) as a continuous linear operator from B to 
B*. 
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(iii) inf uei 2( 0 T;Rm ) Co(u, 0) — Co(0, 0); 

(iv) for all v and Xo the map u i—> C Xo (u,v) : L 2 (0,T;R m ) —> R is convex. 

Proof, (i) => (ii) If u i—> Cq(u, 0) : L 2 (0,T;R m ) — > R is convex, then its 
Hessian is positive or zero and the result follows from identity (2.21). (ii) => 
(iii) From (ii) and the fact that Co(0,0) = 0. (iii) => (iv) Since C Xo (u,v ) is 
quadratic in u, for all u and u' 

C Xo (u', v) - C Xo (■u , v) - dC Xo (u, v; v! - u, 0) 

= —d 2 C Xo ( u , v; u' — u, 0; v! — u, 0) = Cq{u' — u, 0) > Co(0,0) = 0 

from identity (2.21). (iv) => (i) Pick xo = 0 and v = 0. □ 

Corollary 2.1. The following statements are equivalent: 

(i) the map v i—> Co(0,v) : L 2 (0,T;R fc ) — -> R is concave; 

(ii) for all v € L 2 (0,T;R k ) , Co(0, v) < 0; 

(iii) sup„ ei 2 ( 0jT;R fc) Co(0,u) = Co(0,0); 

(iv) for all u and Xq, the map v i—> C Xo (u,v) : L 2 (0,T;R k ) —> R is concave. 


Corollary 2.2. The following statements are equivalent: 

(i) the map (it,i>) Cq(u,v) : L 2 (0,T;R m ) x L 2 (0,T;R fc ) —> R is (u,v)- 
convex-concave; that is, 

Vu G L 2 (0,T;R fc ), u i—> Co(u,v) is convex and 
\/u € L 2 (0,T;R ,u ), v Co(u,v) is concave; 

(ii) the pair (0,0) is a saddle point of Cq(u,v): 

sup Co(0, v) = Co(0,0) = inf Co(u,0); (2.23) 

veL 2 (0,T;R k ) uei 2 (0,T;R m ) 

(iii) sup t , gi 2 ( 0 T;R fe) Co(0,u) = Co(0,0) = inf uei 2 ( 0 i T ; R m ) Co(u, 0); 

(iv) for all xo the map (u,v) C Xo (u,v) : L 2 (0,T;R m ) x L 2 (0,T;R fc ) — > R 
is (u,v)-convex-concave; that is, 


\/v £ L 2 (0,T;R k ), u i—► C Xo (u,v ) is convex and 
\/u £ L 2 (0,T;R m ), v e-> C Xo (u,v) is concave. 


(2.24) 


3 Saddle point and coupled state-adjoint state system 

We first obtain necessary and sufficient conditions for the existence of a saddle 
point of the game and introduces the coupled (state-adjoint state) system (cf. 
Notation 3.1 on page 56) that will also arise in the characterization of the 
open loop lower and upper values of the game in §4. Theorem 5.1 in §5 will 
later complete this theorem with the equivalent condition that the value v(xq) 
of the game is finite. 
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Theorem 3.1. The following conditions are equivalent: 

(i) There exists an open loop saddle point of C Xo (u,v). 

(ii) There exists a solution ( u,v ) in L 2 ( 0,T;R m ) x L 2 ( 0,T;M fe ) of the system, 

\/u € L 2 (0,T;R m ), Vv € L 2 (0,T;R k ), dC Xo (u,v;u,v) = 0, (3.1) 

and C Xo is convex-concave in the sense of (2.24). 

(iii) There exists a solution (x,p) £ 1? 1 (0, T; R 11 ) 2 of the coupled system 

( x' = Ax - BiB{p + B 2 B 2 p, a;(0)=a;o 
\p' + A*p + Qx = 0, p(T) = Fx(T), 

u=-B{p, v = B* 2 p, (3.3) 

and 

sup Co(0, v) = CVO, 0) = inf Co(w,0). (3.4) 

i;6L 2 (0,T;R fc ) «ei 2 (0,T;R m ) 

Under any one of the above conditions, the value of the game is given by 

v(x 0 ) = C Xo (u,v) =p(0) ■ x 0 - (3.5) 

Proof, (i) => (ii). Let {u,v) in L 2 (0,T;R m ) x L 2 (0,T;R fc ) be an open loop 
saddle point of C Xo (u , v) in L 2 (0, T; K. m ) x L 2 (0, T; R fc ). Then by Definition 2.1 

sup C Xo (u,v) = C Xo (u,v) = inf C Xo (u, v). (3.6) 

L 2 (0,T;R fc ) L 2 (0,T;R m ) 

Since C Xo (u,v) is infinitely differentiable, the minimizing point u of C Xo (u,v) 
with respect to u is characterized by the first order condition dC Xo (u, v; u, 0) = 
0 for all u and the second order condition d 2 C Xo (u, v; u, 0; u, 0) > 0 for all u. 
Since d 2 C Xo (u, h; u, 0; u, 0) is independent of ( u,v ) and xo, C Xo (u,v) is con¬ 
vex in u for all xq and all v. A similar argument for the maximum yields 
dC Xo (u, v;, w) =0 and d 2 C Xo (u, v ; 0, w ; 0, w) < 0 for all w and the concavity 
of C Xo (u,v) in v. 

(ii) => (i). By assumption C Xo (u, v) is convex-concave and infinitely differ¬ 
entiable and there is a solution to the two first order conditions. By I. Eke- 
LAND and R. Temam [1], there exists a saddle point. 

(ii) (iii) From the previous computations of the gradient and Corol¬ 
lary 2.2. 

Finally, for the computation of the value 

C Xo {u,v) = Fx(T) ■ x(T) + ( Qx,x) + \\B\p\l 2 - HR^II 2 

= p(T) ■ x(T) - {p' + A*p , x) + ({BiB* - B 2 B*]p,p) 

= p( 0) • a;(0) + ( p, x' - Ax + (\_BiB{ - B 2 B 2 \p) = p(0) • x 0 - 

□ 
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Notation 3.1. System (3.2) will be referred to as the coupled state-adjoint state 
system or simply the coupled system. It will also be useful to denote by A f x , P 
the set of all solutions ( y , q) of the associated homogeneous coupled system 

y' =Ay-B l B* l q + B 2 B*q, 2/(0) = 0, 
q' + A* q + Qy = 0, q(T) = Fy(T). 

Thus system (3.2) has a solution up to an additive pair of Af x , p 


(3.7) 

□ 


4 Finite open loop lower value 

In this section we give a set of necessary and sufficient conditions for the 
finiteness of the open loop lower value of the game. By dual assumptions, we 
also get a set of necessary and sufficient conditions for the finiteness of the 
open loop upper value of the game. We first state the main theorems. Then, we 
proceed in three steps: existence and characterization of a minimizer for each 
v € V[xq), formulation of the resulting maximization problem with respect 
to v £ V(xq), and existence and characterization of the pair that achieves the 
finite open loop lower value of the game. Finally, we prove the uniqueness of 
the solution of the coupled system under the assumption that the open loop 
lower value is finite for all initial states in §4.6. 


4.1 Main theorems 


The quadratic character of the problem yields surprising equivalences that 
reduce the complexity of its solution. We start with the open loop lower value 
of the game. 

Theorem 4.1. The following conditions are equivalent. 

(i) There exist u in L 2 (0,T;R m ) and v in L 2 (0,T;R fe ) such that 


C Xo {u,v)= inf C Xo (u,v) 

weL 2 (0,T;R m ) 


sup inf 

v6L 2 (0,T;R fc ) weL 2 (0,T;R m ) 


C Xo (u,v). (4.1) 


(ii) The open loop lower value i> _ (:ro) of the game is finite. 

(iii) There exists a solution ( x,p ) € H 1 (0,T;R n )xH 1 (0,T;R n ) of the coupled 
system (3.2) such that B%p G V{xq), the solution pairs {u,v) is given by 
the expressions 


u = ~B*p, v = B^p, 


(4.2) 


sup inf Co(u,v) = 
'GV(O) «ei 2 (0,T;R m ) 


and 


inf Co{u, 0) = C 0 (0,0). (4.3) 

u6L 2 (0,T;R m ) 
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Under any one of the above conditions, the open loop lower value is given by 
v~(x 0 ) = C Xo (u,v) = p(0) ■ x 0 . (4.4) 

The proof of this main theorem will be given in §4 and §4.5. 

Remark 4.1. The above necessary and sufficient conditions for the finiteness 
of the open loop value of the game complete the results of P. Zhang [1] by 
introducing the feasibility condition (4.3) that is equivalent to saying that the 
open loop lower value of the game is zero and that ( 0 , 0 ) is a solution for the 
zero initial state. It also recasts the results in the more intuitive state/adjoint 
state framework. Condition (4.3) is equivalent to the convexity of C Xo (u, v) 
with respect to u and the concavity of J Xo {v) = inf ug i 2 (o,T ; K m ) C Xo (u, v) with 
respect to v £ V(xo)- □ 

This theorem has a counterpart for the upper value r’ + (a;o) of the game. 

Theorem 4.2. The following conditions are equivalent: 

(i) There exist u in L 2 (0,T;R m ) and v in L 2 (0,T;R fe ) such that 

C Xo (u,v)= sup C Xo (u, v) = inf sup C Xo (u,v). (4.5) 

v6L 2 (0,T;R fe ) MSL 2 (0,T;R m ) <, e £2( 0iT;R k) 

(ii) The open loop upper value u + (a;o) of the game is finite. 

(iii) There exists a solution ( x,p ) € H 1 (0,T;R n )xH 1 (0,T;R n ) of the coupled 
system (3.2) such that —B\p £ U(xq), the solution pairs (u, v) is given by 
the expressions 


u = - B{p , v = B^p 


(4.6) 


and 


inf sup Cq(u,v) = sup Co(0, v) = Co(0,0). (4.7) 

ueu(0) „ 6 L 2 (0,T;R fc ) vei 2 (0,T;R fc ) 

Under any one of the above conditions, the open loop upper value is given by 

v + (x 0 ) = C Xo (u,v) = p(0) ■ x 0 - (4.8) 

Condition (4.7) says that C Xo (u,v) is concave with respect to v and that 
J+(u) = sup t , gi 2( 0 T;R fc) C Xo (u, v) is convex with respect to u € U(xq). 

4.2 Abstract operators and a preliminary lemma 

The differential equation (2.2) has a unique solution x = x(-;xo,u,v) in 
H 1 (0, T ; R") and the solution map 

x 0 ,u,v ^ x(-;xq,u, v): R" x L 2 (0,T;R m ) x L 2 (0,T;R fc ) H x ( 0,T;R") 
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is linear and continuous. Thus we can write 

x{-\ xo, u, v) = Kqx° + K\u + K 2 v (4-9) 

by introducing the following continuous linear operators: 

K 0 : R" -> H 1 (0,T-,R n ), 

K\: L 2 (0, T ; R m ) -> H\0,T-,R n ), (4.10) 

K 2 : L 2 (0,T;R fc ) -4 H l { 0,T;R”). 

Finally introduce the continuous self-adjoint linear map 

A(x,x t ) d = (Qx, Fxt) : i 2 (0, T ; R”) xR"-t L 2 (0,T;R n ) x R n , (4.11) 

the continuous linear compact injection 

*(*) d = (x,x(T)): H l { 0,T;R”) -4 L 2 (0,T;R”) x R n , (4.12) 

and the continuous bilinear form 


q Xo ((u,v), (u,v)) d = (Ai(K 0 x° + I<iu + K 2 v),i(K 0 x° + Kya + K 2 v)) L2xMn 

+ (u,u) L 2 -(v,v) L 2 . (4.13) 


Then 


C Xo (u,v) =q X0 ((u,v),{u,v)). 


Lemma 4.1. Let U be a Hilbert space, M : U —> U a continuous linear self- 
adjoint compact operator, f £ U, c a constant, and j(u) = c+ 2(/, u) + ([/ + 
M]u, u). 

(i) Then the following conditions are equivalent: 


a) 

3 u£U, j(u) = inf j(u), 

u£U 

(4.14) 

b ) 

inf j(u) > — 00 , 
u£U 

(4.15) 

c) 

3u £ U such that [I + M]u + f = 0 

(4.16) 


and \/u £ U, ([/ + M]u, u ) > 0. 

(4.17) 

(ii) Condition (4.16) 

is equivalent to 



\/w £ ker[/ + M], (/, w) = 0. 

(4.18) 


(iii) Condition (4.17) is equivalent to the convexity of j. 
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Proof, (i) a) => b). Obvious, b) =4- c). We proceed by contradiction. Since M 
is compact, 7 + M has closed range Im[7 + M]. 

If (4.16) is not true, then / ^ Im[7 + M] = (ker[/ + M ])■*■ since Im[7 + M] 
is closed. Let P be the orthogonal projection onto Im[7 + M ]. For A > 0, let 
u\ = -A(/ - Pf). Then 

j(u\) =c + 2(f,u\) + ([7 + M]u x ,u x ) = -A|| / - Pf || 2 . 

Since / ^ Im[7 + M), then / — Pf 0, and as A goes to inhnity, j(u\) goes 
to —oo that contradicts condition (4.15). 

If condition (4.17) is not verified, then there exists w 0 such that 

([7 + M]w, w) < 0. 

For A > 0 let u\ = u + A w. Then 

j{u\) = c + 2 (/, u\) + ([7 + M]u\, u\) 

= j(u ) + 2A([7 + M)u + f,w) + A 2 ([7 + M]w,w) 

= j(u) + A 2 ([7 + M]w,w), 

and j(u\) goes to —oo as A goes to infinity since the coefficient of A 2 is strictly 
negative. This contradiction yields (4.15). 

c) => a). From conditions (4.16) and (4.17), there exists a u £ U such that 

j(u) = infj(it). 

u£H 

(ii) Since 7 + M has a closed range, condition (4.16) is equivalent to 
/ e Im[7 + M] = (ker[7 + M]) 1 - => \/w G ker[7 + M], (/, w) = 0. 

(iii) is obvious. □ 

4.3 Existence and characterization of the minimizers 

Theorem 4.3. Given xq € R™ andv € L 2 (0,T;R k ), the following statements 
are equivalent: 

(i) There exists u € L 2 (0,T;M m ) such that 

C X0 (u,v) = J~(v) = uei2 |n f T ;Rm) Cx 0 (u,v). (4.19) 

(ii) inf u eL 2 ( 0 ,T ; K m ) C Xo (u,v ) > -oo (that is, v G V(x 0 )). 

(iii) There exists a pair (. x,p ) G 77 1 (0,T;R") x 77 1 (0,T;R”) solution of the 
system 

j x' = Ax — BiB(p + Biv , x(0) = xo, 

[p 1 + A*p + Qx = 0, p{T) = Fx(T), 

u(t.) = -Bl(t)p(t ), 


(4.21) 
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and 


inf C 0 (u,0) > 0. 
^ei 2 (0,T;R m ) 


(4.22) 


(iv) The convexity condition (4.22) is verified and 


Mq £ N p , xo ■ q(0) + [ v-B^qdt^ 0, 
Jo 


where 


N p ^ {q G H\ 0,T;R") : V(y, q) G N x , p } 


(4.23) 


(4.24) 


and N XiP denotes the set of all solutions (y, q) of the homogeneous system 


y' =Ay-B 1 B* 1 q, y( 0) = 0, 

q' + A*q + Qy= 0, q(T) = Fy(T). 


(4.25) 


Under any one of the avove conditions, for all (x,p) solution of (4.20) 

J x 0 ( v ) = P(°) • x o + [ B^p ■ v - H 2 dt. (4.26) 

Jo 

Proof. The proof of the theorem will require Lemma 4.1. By definition 


qx 0 ({u,v), (u,v)) = (Ai(K 0 x° + K 2 v),i(K 0 x 0 + K 2 v)) L2xRn - ( v,v ) L 2 

+ (Ai(K 1 u),i(K 0 x° + K 2 v)) L2xRn 
+ (Ai(K 0 x° + K 2 v),i{Kru)) L2xRn (4.27) 
+ (Ai(Kiu), i(Kiu)) L2xRn + (u,u) L 2 . 

Let M = [iKi)*A(iK\) and / = (iKi)*Ai(Kox° + K 2 v) and c = (Ai(Kox° + 
K 2 v),i{K 0 x° + K 2 v)) L2xKn - (v,v) L 2 . Then 

C Xo (u,v) = j(u) = c + 2(f,u) + ([I + M]u,u), 

where M is linear, continuous, and compact. So we can use Lemma 4.1. 

(i) (ii) From the equivalence of a) and b) in Lemma 4.1. 

(ii) (iii) From the equivalence of b) and c) in Lemma 4.1 using the 
computation of first and second order derivatives (2.18) and (2.21) in §2.2. 

Condition (4.16) of the set of necessary and sufficient conditions of 
Lemma 4.1 becomes 


3u, Vw G L 2 (0, T ;R m ), ([I+{iK 1 )*A{iK 1 )}u+(iK 1 )*Ai{K 0 x° + K 2 v),u) = 0, 
3u, \/u G L 2 (0,T;R m ), (u,u) + ( Ai(Kox 0 + K\ii + K 2 v),iK\u) = 0, 

3u, Mu G L 2 (0,T;R m ), (u,u) + ( Aix,iy u ) = 0, (4.28) 
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where 


x 1 = Ax + Biu + B 2 V, a;(0) = xq. 

(4.29) 

By introducing the adjoint system 


p’ + A*p + Qx = 0, p{T) = Fx(T), 

(4.30) 

condition (4.28) becomes 



3u, Vit £ L 2 (0, T; ffi. m ), Fx(T)-y u (T)+ f Qx ■ y u + u ■ udt = 0 

Jo 

4=> 3u, Vit £ L 2 (0, T; K™), j [B^p + u] ■ u dt = 0 4=4> u = —B^p. 

Jo 

This means that system (4.20) has at least one solution (x,p). 

Condition (4.22) follows from condition (4.17) and identity (2.21) 

Vit, 2C 0 (u,0) = d 2 C Xo {u,v,u,0;u,0) = 2([I + M]u,u)>0. (4.31) 

(iii) (iv) We use the equivalence between conditions (4.18) and (4.16) 
in Lemma 4.1 (ii). So it is sufficient to explicit condition (4.18). Note that the 
spaces N x . p and N p are both linear. 

Computation of N u = ker[/ + {iKf)*A(iK\)]. Any w £ N u is solution of 

Vu, (fiK{)*A(iK\)w, u ) + (w, u ) = 0, 

Vit, (A(iKiw),iKiu) + (w, u ) = 0, 

Vu, Fy w (T) ■ y u (T) + f Qy w • y u + w • udt = 0, 

Jo 

where y w is the solution of the equation 


y' w = M)w + B x w = 0, y w ( 0) = 0. 
Introduce the solution q w of the adjoint system 

q' w + A*q w + Qy w = 0, q w (T) = Fy w (T). 
By substitution of Qy w and integration by parts 

rT 


(4.32) 


Vu, Fy w (T) ■ y u (T) + [ Qy w ■ y u + w ■ udt = 0 
Jo 

/ [B\q w + w\ ■ udt = 0 w = 
Jo 


'o 

■ Vu, 


~B\q w . 


By substitution of w in (4.32), the pair ( y w ,q w ) is a solution of system (4.25), 
q w G N p , and N u C —B{N p , where the linear subspace N p is given by (4.24). 
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Conversely, if w € B{N p , there exists a solution (y,q) of system (4.25) such 
that w = ~B 2 q and hence y w = y. So by reverting the above sequence of 
equivalences, we conclude that w G N u , and since N p is a linear subspace, 
N u = B*N P . 

Condition (4.18) now becomes 

Vw G N u , Ai(K 0 x° + K 2 v),w) = 0, 

\/w G N u , ( Ai(Kox 0 + K 2 v), iK\w ) = 0, 

\/w G N u , ( Aix , iy w ) = 0, 


where (x,p) is the solution of the system 


This yields 


x' = Ax + B 2 v = 0, x(0) = xo, 
ft + A*p +Qx = 0, p(T) = Fx{T). 


\/w G N u , Fx(T) ■ y w (T) + f Qx-y w dt = 0, 

Jo 


(4.33) 


\/w G N u , x 0 ■ q w {0) + (v,B 2 q w ) = 0 =^\/q£N p , x 0 ■ q(0) + (v, B* 2 q) = 0, 


and hence condition (4.23). □ 

Notation 4.1. Given xq G 1" such that V(xq) ^ 0 and v G V(xo), denote by 
V(v,xo) the set of all solutions (x,p) of system (4.20). It is readily checked 
that for all p G V(v, xq), V{v, xq) = p + N p . □ 


4.4 Intermediary results 
Theorem 4.4. 

(i) The sets N XtP , N p , and B^Np are finite dimensional linear subspaces of 
H 1 ( 0,T;R") 2 , U 1 (0,T;K. n ), and L 2 (0 } T; R fe ), respectively. V(v,Xq) is a 
finite dimensional affine subspace of H 1 ( 0,T;R"). 

(ii) If V(xo) 0 for some xo G K™, V(xq) is a closed affine subspace of 
L 2 (0, T; K. fc ), V(0) is a non-empty closed linear subspace of L 2 (0,T;M. k ), 

F(0) = {B* 2 N P )^, (4.34) 

WGC(xo), V{x o )=v + V{0). (4.35) 

(iii) Given v G V(xq) and p G V(v,xo), define 

v * d = v + P v (o) ( B 2 p - v), (4.36) 

where Pv(o) the orthogonal projection onto V(0) in L 2 (0,T;R fc ). Then 
v* is independent of the choice of p, v* is unique in V(xo) (“I B 2 V(v, Xo), 
and there exists p* G V(v,Xq) such thatv* = B 2 p*. If in addition, B 2 p — 
v G C(O)- 1 -, then v = v* = B 2 p*. 
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Analogs of Theorems 4.3 and 4.4 hold for the open loop upper value. 

Remark 4.2. This theorem is a key element in the proof of the existence of 
a maximizer of the inf problem. The basic ideas and the arguments are due 
to P. Zhang [1]. For completeness, we have added part (i) to show that the 
subspace B 2 N p is finite dimensional and hence closed. This is critical in the 
proof of part (ii). □ 

Proof of Theorem 4.4. (i) From system (4.25), N x>p is a closed linear subspace 
of H 1 ( 0,T;R") 2 as the kernel of the continuous linear map 

(x,p) >-> A(x,p) 

= f (—x' + Ax — Bi B\p, —x(0 ),p + A*p + Qx, Fx(T) — p(T)) 

: H 1 (0,T-,R n ) 2 -> (i 2 (0, T ;R”) x R n ) 2 . 

We now use the fact that a topological vector space is finite dimensional if and 
only if every closed bounded set is compact. Indeed let I\ be a closed bounded 
subset of points (y, q) in N XtP for the L 2 (0, T ; R”) 2 -topology. Since all the ma¬ 
trices in system (4.25) are bounded, the right-hand sides are bounded and 
the derivatives ( y',q') are also bounded in L 2 (0,T;R") 2 and, a fortiori, in 
U 1 (0, T; R") 2 . Since the injection of /f 1 (0, T; R") 2 into L 2 (0, T; R") 2 is com¬ 
pact, then the closure of K in L 2 (0,T;R™) 2 is compact. But, by assumption, 
we already know that K is closed. Thence K is compact in T 2 (0,T;R") 2 and 
N XJ) is finite dimensional. 

(ii) Since V(xo) y^ 0, then, by definition, for all vi, Vi in V(xo), condition 
(ii) of Theorem 4.3 is verified and condition (iii) is also verified for some pairs 
{x\,p\) and ( X 2 ,P 2 ) verifying system (4.20). Therefore, for any a £ R, the pair 
(x a ,p a ) = (ax\ + (l — a)x 2 ,api + (l — a)p 2 ) is also a solution of system (4.20) 
for xq and v a = av± + (1 — a)V 2 G V (xo). Identity (4.35) follows from the fact 
that V(xo) is an affine subspace. Moreover, from (4.35), V(xo) 0 necessarily 
implies that P(0) y ^ 0 . Finally, from condition (4.23) with xq = 0 

»€k(0) \/q € N p , [ v ■ B^qdt = 0 44> v G (B^N p )^ 

Jo 

and V(0) = (B^Np)- 1 , a non-empty closed linear subspace. 

(iii) Given p\, p 2 in V(v,xo), P 2 — Pi G N p and 

v + P V (o){BIp2 -v)- [v + P v{ q){BIpi - v)) = P V (0)( B 2(P2 - Pi)) = 0, 

since B^N p = ^(O)- 1 . So v* is independent of the choice of p £ V(v,Xo)- Since 
V(xo) is affine, then for all v € V(xo), 

v*=v + Pv(o)(B* 2 p -v)£v + V(0) = V(x 0 ), (4.37) 

v * - B* 2 p = v - B* 2 p - P v{0) (v - B*p) G y(0) x = B* 2 N P 
=> 3q G N p such that v* — B 2 p = B 2 q =>• v* = B 2 {p + q) G B 2 V(v, xq), 
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and v* £ E(xo) (~l B^P^v , Xo). This element is unique since for v* and in 
V(x 0 ) n BZV(v,x o), uS - v{ £ 1/(0) n BXN P = 1/(0) n E(O) 1 - = {0}. Finally, 
if B^p-v£ l/(0)-S then from (4.37) we get v = v*. □ 


4.5 Existence and characterization of maximizers of the minimum 


Assume that v (xo) is finite. By definition of V(xq) 


V (x 0 ) 


sup inf 

v&L 2 (0,T;R k ) ueL 2 (0,T;R m ) 


C x o (u, V ) 


S U P J x 0 («)l 

v€V(xo) 


(4.38) 


where V(xo) is a closed affine subspace of L 2 (0,T;R fc ) and by (4.26) and 
condition (4.23) 


,(w) = inf 

5 «ei 2 ( 0,T;R m ) 


C Xo (u,v)=p(0)-x 0 + B^p ■ v — |u| 2 dt, (4.39) 


or, equivalently, 

J X 0 ( V ) = Fx{T) ■ x(T) + [ Q(t)x(t) -x(t) + \Bl(t)p(t)\ 2 - \v{t)\' 2 dt, (4.40) 

Jo 

for all solutions (x,p) of system (4.20). Define the equivalence class [(x,p)] = 
(x,p) + N XtP . Then for each pair v £ E(xo), [(x,p)] is the unique solution in 
77 1 (0, T;R n ) x JT 1 (0,T;R n )/A^ XiP of system (4.20). So the map 


v i-> [(x,p)] : V{xq) 


H 1 { 0,T;R n ) x H 1 { 0,T;R n ) 


A/ 


(4.41) 


X ,P 


is affine and continuous, and the map 


(x,p) i-> (x(T),x,p) 

: H\ 0,T;R") x H 1 {0,T-,R n ) -» R" xL 2 (0,T;R”) x L 2 (0,T;R”) 


(4.42) 


is continuous and compact. 

So we are back to a continuous linear quadratic function J xo (y) that is 
to be maximized over the closed affine subspace E(xo). The state is now the 
pair (x,p) solution of (4.20), but the structure is the same. Lemma 4.1 readily 
extends to the case of a sup over a closed affine subspace and the following 


conditions are equivalent: 

a) 3D £ V(xo), J X0 (v)= sup J~ 0 {v), (4.43) 

v£V(xo) 

b) sup Jx 0 (v) < +oo, (4.44) 

vev(xo) 

c) 3D £ V(xo) such that [I + M]v + f £ h r (0) ± (4.45) 

and \/w £ 1/(0), ([/ + M\w,w) < 0, (4.46) 
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for the new compact operator M corresponding to the new state (x,p). 

It remains to compute the directional derivative of J xo (v) at v € V{xq) in 
the direction w £ H(0). By direct computation from formula (2.18) 

^dC Xo {-B{p, v,0,w) = j {B%p — v) ■ wdt (4.47) 

that is independent of p £ V(v,Xo) for all w £ V(0) from formula (4.23) of 
Theorem 4.3 (iv). Hence 


dJ Xo (v; w) = d,C Xo (- B{p , v; 0, w) 


= 2 f ( B 2 P~v)-wdt , \/p£V(v, xq). 

Jo 


As for the second order derivative: 


1 


d 2 C Xo ( -B{p , v; 0, to; 0, to') 


= Fy w i(T) ■ y w (T ) + f Qy w > • y w + B{q w > • B{q w - w' • w dt 
Jo 

=> ^d 2 J~ 0 (v;w;w) = ^d 2 C Xo {-Blp,v;0,w 1 0,w) 

= -Jn(w) = - inf Co(u,w), 

2 0 y j 2 uCL 2 (0.T;R m ) v ’ 


(4.48) 


(4.49) 


(4.50) 


where the last term must be negative or zero for all w £ V(0). But, from 
Theorem 4.3 (iii), Cq(u, 0) is convex in u. By using the equivalent condition 
of Lemma 2.1 (ii) for the u-convexity of Co(u, 0), we finally get the following 
two-part condition: 


sup inf C'o(u,u)<0< inf Co(u,0). (4-51) 

„ e y( 0 ) ueL 2 (0,T;R m ) uSL 2 (0,T;R m ) 

This condition is equivalent to condition (4.3) since Co (0,0) = 0. Indeed 
condition (4.3) implies condition (4.51). Conversely from condition (4.51) 

Co(0,0) = 0 < inf Co(u,0)< sup inf Cq(u,v) 

uGL 2 (0,T-,R m ) v eV( 0 ) «eL 2 (0,T;R m ) 

sup inf Co(u,v) < inf Cq(u, 0) < Co(0, 0) = 0, 

vev(0) M6i 2 (0,T;R m ) ueL 2 (0,T;R m ) 

and this yields condition (4.3). 

Proof of Theorem 4.1. (i) => (ii) is obvious, (ii) => (iii) From the previous 
discussion, the finiteness of u _ (a;o) is equivalent to 

3t) £ V(xo) such that dJ~ 0 (v;w) = 2 f (B 2 P — v) ■ wdt = 0, \/w £ V(0), 

Jo 

d 2 Jl(v;w;w) = 2 inf Co(u,w)<0, Vw£h(0). 

X ° neL 2 (0.T;R m ) 
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The second order condition combined with the fact that V(xo) ^ 0 (the 
equivalence of part (ii) and (iii) in Theorem 4.3 and hence the convexity 
inequality (4.22)) yields condition (4.3). The first order condition says that 
B^p — v G F(O)- 1 -. By Theorem 4.4 (iii) there exists p* G V(v,xq) such that 
v = B 2 P*, where ( x*,p *) is a solution of (4.20). Since v = B^p*, the coupled 
system (3.2) has a solution unique up to an element of Af XyP . After substitution 
of v = B2P* in (4.20), (x*,p*) becomes a solution of the coupled system (3.2). 
This also yields the identities (4.2). (iii) => (i) By assumption v = B^p € 
V(xo)- The existence of a solution (x,p) to system (3.2) yields the existence 
of a solution to system (4.20) of Theorem 4.3 (iii) with u = —B^p as a 
minimizer. For all v G V(xq) 

Jx 0 M = 4“o ( B 2p) + dJ- {B%p; v - B* 2 p) + \d 2 j~ 0 {B^p; v - B* 2 p ; v - B* 2 p). 

The second order term is negative by condition (4.3) since, by assumption, 
B2P G V(xo) and hence v — G V(0) for all v G V(xo). As for the first 
order term, recall that, in view of (4.2), for all w G V(0) 

dJ x 0 ( S 2P ; w ) = [ ( B 2P -v)-wdt = 0 . 

J 0 

Thus dJ~ 0 {B^p; v — B2P) = 0 since v — B2P G V(0). Hence HJp is a maximizer 
of J~. □ 


4.6 Finite open loop lower value for all initial states and 
uniqueness of solution of the coupled system 

In this section we sharpen the results of the previous section when the open 
loop lower value, value, or upper value of the game is finite for all initial state 
xo G R". In each case this global assumption yields the uniqueness of solution. 

Theorem 4.5. The following conditions are equivalent: 

(i) For each Xq G R”, there existu mL 2 (0,T;R m ) and v mL 2 (0,T;R fe ) such 
that 


c. 


Xn (u, v) = inf 

0V ' «ei 2 (0,T;I 


C X0 {u,v) = 


sup 

>GL 2 (0,T;I 


inf 

, ttei 2 (0,T;R m ) 


C X0 {u,v). (4.52) 


(ii) For each xo G R n , the open loop lower value v~(xq) of the game is finite. 

(iii) For each xo G R", there exists a unique pair ( x,p ) G H 1 ( 0,T;R n ) 2 so¬ 
lution of the coupled system (3.2) such that B^p G V(xo), there exists a 
unique pair (u,v) that verifies (3.3), and 

sup inf Co(u, 0) = 

■uGV(O) uGL 2 (0,T;R m ) 


inf Co(u,0) = C 0 (0,0). (4.53) 

MGL 2 (0,T;R m ) 
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Note that under any one of the above conditions, (0, 0) is the unique solution 
of (4.53). 

Remark 4.3. The uniqueness under condition (i) was originally given by 
P. Zhang, G. Zheng, Y. Xu, and J. Xi [1] by a different argument. Our 
short and transparent proof seems to be new. The same proof can readily be 
used in the context of Optimal Control (cf. J. L. Lions [3]) . □ 

Proof, (i) => (ii) is obvious, (ii) => (iii). From Theorem 4.1 where condi¬ 
tion (4.53) is condition (4.3). We only need to show the uniqueness of solution 
to the coupled system (3.2). By linearity, this amounts to prove that the so¬ 
lution (y,q) of the homogeneous system (3.7) such that B^q € V(0) is (0,0). 
Given an arbitrary xq consider the expression 

g(0) • Xo = q(T) ■ x(T) — f q' ■ x + q ■ x' dt 
Jo 

= Fx(T) ■ y(T) + [ Qx-y + B* lP -B*q- B*p-B*qdt 
Jo 

= ^dC Xo (u,v; -B*q, B%q) = 0 

from (2.15), (3.2), (4.2), and the fact that B%q € V(0). Since this identity 
is true for all Xq € R”, then < 7 ( 0 ) = 0. But now we can look at the coupled 
system (3.7) as a linear differential system of 2 n equations in (x,p) with zero 
initial condition (y( 0 ), q(0)) = ( 0 , 0 ) whose unique solution is (y,q) = ( 0 , 0 ). 
This proves the uniqueness, (iii) => (i). Again from Theorem 4.1 since the 
conditions are verified for each xq G R". □ 

We readily have the dual result. 

Theorem 4.6. The following conditions are equivalent: 

(i) For each xq € R™, there existu ini 2 (0,T;K m ) andv mL 2 (0,T;R fe ) such 
that 

C Xo (u,v) = sup C Xo (u,v) = inf sup C Xo (u,v). (4.54) 

veL 2 (0,T;R fe ) uei 2 (0,T;R m ) v£ L 2 (0,T-,R k ) 

(ii) For each Xo € R™, the open loop upper value u + (xo) of the game is finite. 

(iii) For each xo € R™, there exists a unique pair (x,p) € 1L 1 (0,T;R ™) 2 solu¬ 
tion of the coupled system (3.2) such that —B^p € U(x 0 ), there exists a 
unique pair (u,v) that verifies (3.3), and 

inf sup Co(u,v) = sup Co(0, v) = Cq(0, 0). (4.55) 

uSE/(0) v£ L 2 (0,T;R k ) v£L 2 (0,T;R k ) 

Again, under any one of the above conditions, (0, 0) is the unique solution 
of (4.55). 
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5 Finite open loop value and open loop saddle point 

In this section we show that the necessary and sufficient condition for the 
finiteness of the value u(a;o) of the game is the existence of a saddle point 
of the utility function or a Nash equilibrium (cf. footnote 1 on page 48). In 
the process, we complete the characterization of an open loop saddle point in 
Theorem 3.1 by showing that the, a priori, convexity-concavity of the utility 
function is in fact necessary. 

Theorem 5.1. The following conditions are equivalent: 

(i) There exists an open loop saddle point of C Xo (u,v). 

(ii) The open loop value u(a;o) of the game is finite. 

(iii) There exists a solution ( x,p ) € H 1 (0,T;R n )xH 1 (0,T;R n ) of the coupled 
system (3.2), the solution pair ( u,v) is given by the expressions (3.3), and 
the convexity-concavity (3.4) is verified. 

Under any one of the above conditions, the open loop value is given by (3.5). 

Proof, (i) =>■ (ii). Since the utility function has a saddle point, the value of the 
game is finite, (ii) => (iii). From Theorems 4.1 and 4.2, there exists a solution to 
the coupled system (3.2) and the convexity-concavity condition (3.4) readily 
follows from (4.7) and (4.3). (iii) => (i). From condition (3.4) C Xo (u,v) is 
convex-concave. Moreover the coupled system (3.2) has a solution. Therefore 
by Theorem 3.1 (iii) C Xo (u,v ) has an open loop saddle point. □ 

Remark 5.1. The common part of the necessary condition for the finiteness of 
the lower value i>~(;ro), value v(xq), and upper value u + (a;o) of the game is 
the existence of a solution of the coupled system (3.2). The difference is in the 
respective feasibility conditions (4.3), (3.4), and (4.7): f“(0) = 0, f(0) = 0, 
and t! + (0) =0. □ 

We conclude with the enlightening result proved by P. Zhang [1] (Theo¬ 
rem 4.1) that has shed new light on the characterization of a game with finite 
value. One of the consequences is that only three cases can occur: (i) c + (xo) 
finite and v~(xq) = — oo, (ii) t> + (a:o) = +oo and v~(xo) finite, and (iii) v(xq) 
finite. So the duality gap is either +oo or 0. 

Theorem 5.2. Given xo G R n , the following statements are equivalent: 

(i) There exists an open loop saddle point of C Xo (u,v). 

(ii) The open loop value of the game of C Xo (u,v) is finite. 

(iii) Both the open loop lower and upper values of C Xo ( u , v) are finite. 

Proof, (i) => (ii) => (iii) are obvious. It remains to prove that (iii) => (i). 
From condition (4.3) of Theorem 4.1 and condition (4.7) of Theorem 4.2, we 
get condition (3.4) of Theorem 5.1. Finally, Theorems 4.1 and 4.2 together 
give the existence of a pair (x,p) € i7 1 (0,T;R") x H 1 (0,T;R n ) solution of 
the coupled system (3.2). Therefore by Theorem 5.1 the utility function has 
a saddle point. □ 
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We now get uniqueness of solution to the coupled system when the value 
of the game is finite for all initial state xo G R” by combining Theorems 4.6 
and 4.5 of §4.6. 

Theorem 5.3. The following conditions are equivalent: 

(i) For each xo G R n , there exists an open loop saddle point of C Xo (u,v). 

(ii) For each xq G R", the open loop value v(xq) of the game is finite. 

(iii) For each Xq G R”, there exists a unique pair (x,p) G U 1 (0,T;M n ) 2 so¬ 
lution of the coupled system (3.2), there exists a unique pair (u,v) that 
verifies (3.3), and the convexity-concavity condition (3.4) is verified. 

Under any one of the above conditions, (0, 0) is the unique solution of (3.4). 


6 Riccati differential equation in the open loop saddle 
point case 


6.1 Invariant embedding with respect to the initial time 

Consider the linear quadratic game on the time interval [s,T], 0 < s < T, 
with initial state h G R" at time s 

[ T 

Cj)(u, v) = f Fx(T) ■ x(T) + / Qx ■ x + [u\ 2 — \v\ 2 dt, (6.1) 

J S 

x' = Ax + B\u + BiV a.e. in [s,T], x(s) = h. (6-2) 


Definition 6.1. Let h G 


be an initial state at time s, 0 < s < T. 


(i) The game is said to achieve its open loop lower value (resp. upper value) 
if 


v s (h) d = sup inf Cl(u,v), 

veLH s .T^)^LHs.T;R^) 


(6.3) 


(resp. vf(h) = f inf sup C?(u,v)) (6.4) 

uGL^s.T; R"“)„ eL 2 (SiT; , 


is finite. 

(ii) The game is said to achieve its open loop value if its open loop lower value 
vf(h) and upper value vf~(h) are achieved and vj(h) = vf(h). The open 
loop value of the game will be denoted by v s (h). 

(iii) A pair ( u,v ) in L 2 (s,T; R m ) x L 2 (s,T; R fc ) is a open loop saddle point of 
C^{u,v) if for all u in L 2 (s,T;R m ) and all v in L 2 (s,T\ R fc ) 


(6.5) 

□ 


Ch(u,v) < C£(u,v) < C s h {u,v). 
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6.2 From convexity/concavity in [0,T] to [s,T] 

The first result is that, if the utility function C Xo ( u , v) is convex, concave, or 
convex-concave for some xo on [0,T], so is C^(u,v) for all h £ R™ on [s,T] 
and all s, 0 < s < T. 

Theorem 6.1. (i ) If, for all ( xq,v ) € R" xL 2 (0,T;R fc ), the map u i—> 
C Xo ( u , v ) is convex, then for all s, 0 < s < T, and all (h , v ) € 
R” xL 2 (s,T; R fc ) the map u i—> C^{u,v) is convex. 

(ii) If, for all (xo,u) € R" xL 2 (0,T;R m ), the map v i—> C Xo (u,v) is concave, 
then for all s, 0 < s < T, and all ( h,u ) € R" xL 2 (s,T;R™) the map 
v i—> C^(u,v) is concave. 

Proof. We only prove (i). From identities (2.19) and (2.21) for all (u,v) £ 
L 2 (0,T;R m ) xL 2 (0,T;R k ) 

Vu£L 2 (0,T;R m ), d 2 C Xo (u, v; u, 0; u, 0) 

= Fy(T) ■ y(T) + (Qy , y) + (u,u)> 0, 


where y is the solution of 


y^Ay + Bm, y{ 0) = 0. 


(6.7) 


To prove the same result on [s,T], associate with each u £ L 2 (s,T;R m ) its 
extension by zero u from [s,T] to [0, T], Therefore 

Mu £ L 2 (s,T;R m ), Fy{T) ■ y(T) + [ Qy-y)+u-udt> 0, ( 6 . 8 ) 

Jo 

where y is the solution of 

y' = Ay + Biu, y( 0) = 0. (6.9) 

Notice that, since u is zero in [0, s], y = 0 in [0, s] and y is also solution of 

y' = Ay + i?iu, y(s) = 0, (6.10) 

=tV«eL 2 (s,r;R m ), Fy(T) ■ y(T) + f Qy ■ y) + u ■ udt > 0. (6.11) 

J S 

Hence for all h £ R", all ( u,v ) £ L 2 (s,T;R m ) x L 2 (s,T\R k ), and all u £ 
L 2 {s,T- R m ) 

d 2 Ch(u,v;u, 0;u,0) = Fy(T) • y(T) + f Qy ■ y) + u ■ udt 

J S 

= d 2 C Xo (0, 0; u, 0; u, 0) > 0. 

Thus for all s and all {h,v), the map u i—> C/(u,u) is convex. □ 
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6.3 Open loop saddle point optimality principle 

At this juncture, it is important to notice that the necessary conditions (4.3) 
and (4.7) associated with the respective finiteness of the lower and upper 
values of the game on [0, T] do not generally survive on [s,T]. However the 
convexity-concavity condition (3.4) does. 

Theorem 6.2. Assume that i>(xo) is finite for some Xo £ R", denote by 
(x(-',Xo),p(-',Xo)) a solution of the coupled system (3.2) in [0,T], and let s, 
0 <s<T. 

(i) The value v s (x(s',Xo)) of the game is finite. 

(ii) The restriction of (x,p) to [s,T] is a solution of the coupled system 

j x' s = Ax s - BiB^ps + B 2 B 2 PS a.e. in [s,T], x s (s) = x(s; x 0 ), 

\ p' s + A*p s + Qx s = 0, Ps(T) = Fx s (T), 

the restrictions (u s , v s ) = (u|[ s ,t])^[s,ti) of the controls (u,v) on [0,T] to 
[s,T] verify 

u s = —Blps and v s = B£p s , v s (x(s; x 0 )) = p s (s) ■ x(s; x 0 ), (6.13) 

v(x 0 ) = v s {x(s;x 0 )) + f Qx ■ x + [u\ 2 - \v\' 2 dt, (6.14) 

J 0 

and 

sup C^O, t) = Co (0)0) = inf C 0 S ( M ,0). (6.15) 

veL 2 (s,T;R k ) u£L 2 (s,T; R ) 

Proof. From Theorem 5.1 on [s,T], part (i) is equivalent to part (ii) and it is 
sufficient to prove part (ii). From Theorem 6.1, the convexity-concavity condi¬ 
tions on [0, T] survive on [s, T\ and we get (6.15). Moreover if (#(•; xq),p(-\ Xo)) 

is a solution of the coupled system (3.2) in [0, T] with initial state Xo at 

time 0 and the controls (u,v) verify identities (3.3), then the restrictions 
(. x s ,p s ) = (x|[ Sj t],p|[ s ,t]) is a solution to the coupled system (6.12) and the 
restrictions (u s ,v s ) = (u|[ s ,t]> W[s,ti) of the the controls on [0,T] verify (6.13). 
So, by the analog of Theorems 5.1, we get the finiteness of the value of the 
game on [s, T]. □ 

Theorem 6.3. Assume that v(xq) is finite for all xq £ R". 

(i) The solution (x s ,p s ) of the coupled system (6.12) and the controls (u s ,v s ) 
on [s, T] in (6.13) are unique. 

(ii) The map 


xo 1 —> X(s)xo = x(s;xo) : R” —> R" (6.16) 

is a linear bijection, where (x(-;xo),p(-;xo)) is the unique solution of the 
coupled system (3.2) in [0, T]. 
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(iii) For all h £ K™, the utility function C^(u,v) has a unique open loop sad¬ 
dle point ( u s ,v s ) £ L 2 (s,T;K m ) x L 2 (s,T;R k ) and there exists a unique 
solution ( x s ,ps ) of the coupled system 

( x' s = Ax s - BiB\p s + B 2 BIp s a.e. in [s,T], x a (s) = h, 

[ p' s + A*p s + Qx s = 0 a.e. in [s,T], Ps{T) = Fx s (T), 

such that u s = —Blp s and v s = B^Ps- (6.18) 

Proof. Recall that under the assumption that v(xo) is finite, C^(u,v) is 
convex-concave for all s. This means that a saddle point of C% is completely 
characterized by the existence of a solution of the coupled system on [s,T]. 

(i) Assume that the pair (u s ,v s ) is a saddle point of CJ( S ) on the time 
interval [s,T]. Denote by (x a ,p s ) the corresponding solution to the coupled 
system (6.12). Consider the following new pair on the interval [0,T]: 


~ def 
U = 



in [0, s\ _ def I v, in [0, s], 

in [s,T] 1 v s , in [s,T], 


(6.19) 


and the corresponding solution (x.p) to the state-adjoint state system (2.3)- 
(2.17). 

If it can be shown that the pair (u, v) is a saddle point of C Xo ( u , v) on [0, T], 
then by uniqueness of the saddle point on [0, T], we can conclude that (u, v) = 
(u,v) and hence (u s ,v s ) = (u|[s,t]> t)|u,r])- From this we get the uniqueness 
of the saddle point of on [s,T] and the uniqueness of solution to the 

coupled system (6.12). The first remark is that x(s) = x(s) and from (6.14) 


C Xo (u,v) = v(x 0 ) = [ Qx- x+ \u\ 2 - \v\ 2 dt + v s (x(s)) 

Jo 

= f Qx ■ x + \u\ 2 - \v\ 2 dt + Fx s (T) ■ x s (T) + f Qx s • x s + 
Jo Js 


u» - fits 


' dt 


C Xo (u,v) = C Xo (u,v). 


Yet, this is not sufficient to conclude that (u, v) is a saddle point of C Xo (u, v). 
We must show that 


sup C Xo (u, v) = C Xo (u, v) 

D6L 2 (0,T;R k ) 


inf 

neL 2 (0,T;R m ) 


C Xo (u , v). 


( 6 . 20 ) 


The second remark is that, since (u — u,v — v) is equal to (0,0) on [0, s], 
(u s — u,v s — v) is a saddle point of Cq(u s ,v s ). Combining this with the fact 
that, by (6.15), (0,0) is also a saddle point of Cq(u s ,v s ), the pairs (u s — u, 0) 
and (0, v s —v) are also saddle points of Cq(u s ,v s ) and Cq(u s —u , 0) = Cq(0, 0 s — 
v) = 0. The third remark is that 

C Xo (u,v) = C Xo (u,v) + dC Xo (u,v;0,v - v) + C o (0,v - v) 

= C Xo (u,v) + C o (O,0 - v). 
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But, since v — v is equal to 0 on [0, s], 

Co(0, v - v) = Cq (0, v s - v) = 0 => C Xo ( u , v ) = C Xo (u, v ) = C Xo (u, v). 
We now prove the second part of identity (6.20): 

C Xo (u, v) = C Xo (u,v) + dC Xo (u,v;u- u, 0) + C 0 (u - u, 0). (6.21) 

Since (0, 0) is a saddle point of Cq(u, v) 

inf Cq(u — u,0) = inf Co(w,0)=0. 

«GL 2 (0,T;R m ) ■ueL 2 (0,T;R m ) 

It remains to prove that for all u € L 2 (0,T;M m ), dC Xo (u,v;u — u, 0) = 0. 
First observe that 

dC Xo (u, v;u — u, 0) = dC Xo (u, v; u — u, 0) + dCo(0, v — v; u — u, 0) 

= dCo(0, v — v;u — u, 0). 

Since (0,D S — v) is a saddle point of Cg on [s, T], there exists a pair (£, 7 r) 
solution of the coupled system 


= A£ - BxBl 7T + B 2 B* 2 tt a.e. in [s,T], £(s) = 0, 


( 6 . 22 ) 


\ tt' + A*tt + = 0, tt(T)=F{(T), 

0 = -B?tt, v s -v = B* 2 tt. (6.23) 

The first equation can also be written as 

= M, + B 2 (y s - v) a.e. in [ s,T ], £(s) = 0. 

Denote by £ the solution of the state equation (2.3) on [0, T] corresponding 
to the initial state 0 and the control pair (0, v — v) 

£' = Ai + B 2 (v - v) a.e. in [0, T], |(0) = 0, 

and observe that, since the restriction of v — v to [0, s] is 0, £ = 0 on [0, s] and 
£ = £ on [s, T\. Denoting by y the solution of 

y' = Ay + Bi(u - u) a.e. in [0,T], y{ 0) = 0, 

we get the following expression (cf. (2.15) and (2.18) for the directional de¬ 
rivative) : 

dCo(0, v — v; u — u, 0) 

= f£(T) ■ y(T) + [ Q£-y + 0-(u-u) + {v-v)-0dt 
Jo 

= f£(T) ■ y(T) + [ Qi-ydt = f£(T) ■ y(T) + [ Q£-ydt 

JO Js 

= F£(T)-y(T)+ f Q£-ydt= f B{-k ■ (u - u) dt = 0, 

J S J S 
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since B\n = 0 on [s,T] from (6.23). This establishes the second part of ex¬ 
pression ( 6 . 20 ). 

The proof of the first part is dual to the proof of the second part. This 
yields the uniqueness and completes the proof of part (i). 

(ii) The map (6.16) is clearly linear (and continuous). Assume that it is 
not bijective, then there exists some xq € R n , Xo ^ 0, such that x(s) = 0. The 
restriction of (x,p) to the interval [s,T] is a solution of the system 

f £' = B 1 Bln + B 2 B 2 TT a.e. in [s,T], £(s) = 0 = x(s), 

l n' + A*n + Q£ = 0 a.e. in [s,T], tt(T) = F£(T). 


But from part (i) the unique solution of system (6.24) is (0,0). Hence 


(x,p) = (0,0) in [s,T] => (x(s),p(s)) = 

x' = Ax — BiB^p + B 2 B 2 P a.e. in [0, s], 
p' + A*p + Qx = 0 a.e. in [0, s], 


( 0 , 0 ), 
x(s) = 0 , 
p(s) = 0 , 


=> (x,p) = ( 0 , 0 ) in [ 0 , s] => Xq = x( 0 ) = 0 . 


This contradicts our initial conjecture that Xo 7 ^ 0, and we conclude that the 
linear map (6.16) is injective and, a fortiori, bijective. 

(iii) From part (i) for each h £ K™ and each s, 0 < s < T, there exists a unique 
ho £ R” such that h = X(s)ho- But Ch 0 {u, v ) has a unique open loop saddle 
point in [0,T]. From part (i), ^ ias a un ' c l ue °P en 1°°P saddle 

point in [s,T]. The result now follows from the fact that h = X(s)ho- The 
equations and the identities follow from theorems from Theorem 6.2 (ii). □ 

Remark 6.1. The proof of part (i) is not trivial. It is one of the key elements 
to get the result of part (iii) that says that C%(u, v ) has a saddle point for all 
initial state h and all initial times s. □ 


The next example illustrates that even when the coupled system has a unique 
solution in the time interval [0, T\, the uniqueness is not necessarily preserved 
on a smaller interval [s, T]. 

Example 6.1. Consider the one-dimensional example of P. Bernhard [2, Ex¬ 
ample 5.1, page 67] in [0, 2] with xq £ R 

x' = (2 — t)u + tv in [ 0 , 2 ], 
z(0) = x 0l 

C X0 (u,v ) = i|a;(2)| 2 \u\ 2 - \v\ 2 dt 

The solution of the coupled loop system 


(6.25) 

(6.26) 
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p-I-P-O’ + tVmM, (V = 0 in [0,2], 

\*(0) = ® 0) jp( 2) = -s(2), 

is given by the expressions 

x(t) = {t- l) 2 x 0 , p(t ) = ^a; 0 . (6.28) 

So it exists and is unique for all Xo G R. At time t = 1, x(l) = 0 for all xq G M. 

Now consider the closed loop system in the time interval [1,2] for the initial 
condition 0 at time t = 1 


j z'i = [~(2 - t) 2 + t 2 ] Pi in [1, 2], 

\5i(l)=0, 

Its solution is given by the expression 


Pi = 0 in [1,2], 
Pi (2) = ^i(2). 


x\(t) = 2(t — l) 2 c, pi(t)=c, 


(6.29) 


(6.30) 


up to an arbitrary constant c G R. So the solution of this homogeneous system 
is not unique. The concatenation u of u on [0,1] and u\ on [1,2] associated 
with c/io/2 as defined in (6.19) yields 

j 3? = (2 — t)ii +tv in [0,2], r p' = 0 in [0,2], 

)i(0) = Xo, |p(2) = tj(2). 

It is readily seen that x{l) = x(l) at time t = 1, but that the adjoint systems 
do not coincide: p(l) = io/2/c = p(l) (and in fact for all t G [0,2]). □ 


6.4 Decoupling of the coupled system 

We need the following lemma. 

Lemma 6.1. Assume that the open loop saddle point value v(xq) is finite for 
all xq G R n . Let s, 0 < s < T, and (x s ,p s ) be the unique solution of the 
coupled system (6.17) with initial state h at time s. Then the map P{s) 

h i—> P(s)h d = p s (s) : M” —> R n (6.32) 

is linear, continuous, and symmetrical. 

Proof. By definition, P(s) is linear and continuous. For the symmetry, let 
(x,p) and (x,p) be the solutions of the coupled system (6.17) for the respective 
initial states h and h at time s. By symmetry of F, Q(t ) and Bi(t)Bl(t) — 
B 2 (t)B* 2 (t) 
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P(s)h ■ h = p(s) ■ x(s) = p(T) ■ x(T) — / p' ■ x + p ■ x' dt 

J S 

= Fx(T) ■ x(T) 

— f -(A*p + Qx)-x + p-(Ax — BiBlp + B2B2p)dt 

J S 

= Fx(T) ■ x(T) + f Qx-x+p ■ {B-lBI - B 2 B%)pdt = P(s)h • h 

J S 

and P(s)* = P(s). □ 

In view of Lemma 6.1, we use invariant embedding to get more a priori 
information on the decoupling matrix function P(s). 

Theorem 6.4. Assume that v(xq) is finite for all Xo € R n . 

(i) Given the solution of the coupled system (3.2) in [0,T] for Xo € 

p(s) = P(s)x(s), 0 <s<T. (6.33) 

(ii) The elements of the matrix function P are H 1 (0 ,T)~functions, the ele¬ 
ments of the matrix functions 


A P d = A~ RP, R d = BiB{ ~B 2 B%, 


(6.34) 


belong to L°°(0,T), and the closed loop system 

x' = [A - (BiB{ - B 2 B 2 )P]x a.e. in [0,T], x(0) = x 0 , (6.35) 

has a unique solution in H 1 ( 0,T;K"). For all (t,s), 0 < s < t < T, 
the fundamental matrix solution (Pp(t,s) associated with the closed loop 
system (6.35) and its inverse Fpft^s) -1 are continuous in {(t, s) : 0 < 
s < t < T}. For all pairs 0 < s < t < T 


d_ 

ds 


Fplt, s) + <Pp(t, s)Ap(s) = 0 a.e. in [0, t], <Pp{t,t)=I. (6.36) 


Proof, (i) From Theorem 6.2 and Theorem 6.3 (i) 

X a =x \[ SiT ], Ps=P\[s,T] => P(s) = fis{s) = P(s)x s (s) = P(s)x(s), 

and we get (6.33). The closed loop system is obtained by direct substitution 
of the identity (6.33) for p into the first equation of the coupled system (3.2) 
in [0, T], 

(ii) Associate with the solution of the coupled system (3.2) in [0, T], the 
matrix function 


def 


A(s)a’o = p(s;xo), Vxq € R n , 0 < s < T. 


(6.37) 


From (6.33) in part (i) and the invertibility of X(s) 
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yl(s)x 0 = P{s)X(s)x 0 , V® 0 G R", 0 <s<T 

=> T(s) = P(s)X{s), => P{s) = A(a)X(a)~ 1 , 0 <s<T. 

Since X(s) is invertible and the elements of the matrices X and A are 
H 1 (0, T)-functions 

P'(s) = yl(s)'X(s)- 1 - yl(s)X(s)- 1 X(s) , X(s)- 1 . (6.38) 

In particular the elements of the matrix function P are JT 1 (0, T)-functions. 
Then the matrix function A pit) in (6.34) belongs to L°°(0,T) and the closed 
loop system (6.35) has a unique solution in H 1 ( 0,T;R ra ). From this T>p has 
the usual properties of a fundamental matrix solution T>p in {(t, s) : 0 < s < 
t < T}, <&p(t, 0) = <Pp(t, s)<P P (s, 0), and 

d<Pp 

s) +$p(t,s)Ap(s) a.e. in [0,T], <P P (t,t) = I. (6.39) 

□ 


6.5 Riccati differential equation 

Under the assumption of the finiteness of the open loop value of the game 
in [0, T\ for each initial state, we have used invariant embedding to introduce 
the decoupling symmetrical matrix function P(s). To show that it is a solu¬ 
tion of the matrix Riccati differential equation (2.7), we follow the technique 
of P. Bernhard [2, Lemma 3.1] since, from Theorem 6.3 (ii), the matrix 
function X(s) is invertible for all s, P(s) = A(s)X(s)~ 1 , and P'(s) is given 
by identity (6.38). 

Theorem 6.5. Assume that the open loop value v(xo ) is finite for all xo G l n . 

(i) There exists a unique symmetrical solution with elements in H 1 { 0,T) of 
the matrix Riccati differential equation 

P' + PA + A*P~PRP + Q = 0, P(T) = F, (6.40) 

where R = B\B\ — B 2 B 2 . Moreover, 

pit) = P(t) x(t), 0 < t < T, and C Xo {u, v) = P(0)xo ■ xo, (6-41) 

where (x,p) G IL 1 (0,T;R") 2 is the unique solution of the coupled sys¬ 
tem (3.2). 

(ii) The optimal strategies of the two players are closed loop 

u = —B)Px and v = B)Px, (6.42) 

and they achieve a closed loop-closed loop saddle point in the sense of 
P. Bernhard [2], 
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(iii) For all xo G M" the function C Xo (it, v) is convex-concave. 

Proof (i) From identity (6.38) in the proof of part (ii) of Theorem 6.4 a 
straightforward computation yields that the matrix function P is a solution of 
the matrix Riccati differential equation (6.40). This solution is unique. Indeed 
if P is another solution of the Riccati equation, the closed loop system with 
P has a unique solution x and it is easy to check that p = Px is a solution of 
the associated adjoint equation. But there is a unique solution to the coupled 
system. By definition of P via invariant embedding we get that P = P. (ii) 
and (iii) From identities (4.2) and (4.3) in Theorem 4.1. □ 

Remark 6.2. We shall see in Example 7.1 that the fact that the elements of P 
are H 1 (0,T) is necessary but not sufficient to get an open loop saddle point. 

□ 


6.6 Open loop saddle point and Riccati differential equation 

The existence of a symmetrical solution in H 1 {0,T) to the matrix Riccati 
differential equation (6.40) implies that, for all a’o G R”, there exists a solution 
( x,p ) G H 1 ( 0,T;R") x R 1 (0,T;R”) of the coupled system (3.2). However, as 
we shall see in Example 6.2, this is not sufficient to get an open loop saddle 
point of the utility function C Xo (u,v). 

Theorem 6.6. A set of necessary and sufficient conditions for the existence 
of an open loop saddle point of the utility function C Xo (u,v) for all xq G R" 
is 

a) the utility function C Xo (u,v) is convex in u and concave in v for some xq, 

b) and there exists a (unique) symmetrical solution in H 1 (0,T) to the matrix 
Riccati differential equation (6.40). 

Proof. From Theorem 6.5 we get a) and b). Conversely, from a) if P is a 
solution of the Riccati differential equation, the closed loop system has a 
unique solution xp and pp = Pxp is the solution of the adjoint system. It is 
then easy to check that the pair (xp,pp) is indeed a solution of the coupled 
system (3.2) in [0,T], Finally from the convexity-concavity property b) we 
get the existence of the open loop saddle point. □ 

Remark 6.3. The method of completion of the squares (cf. for instance T. Ba- 
§ar and P. Bernhard [1, Chapter 9, Theorem 9.4] can also be used here to 
obtain 


sup inf 

vGL 2 (0,T-,R k ) 'i*ei 2 (0,T;R m ) 


C Xo (u,v ) < P(0)xq ■ X 0 


< inf sup C Xn (u,v). 

ueL 2 (0,T;M-) ueL2(0iT;Kfc) 


□ 
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So it would be tempting to conclude that there is a saddle point without 
condition a). But this is not true as will be illustrated in Example 6.2 below. 
It is a game without open loop saddle point, where the solution of the Riccati 
differential equation (6.40) is unique strictly positive and infinitely differen¬ 
tiable. In that example it is shown that U(x o) = 0 for all Xo■ In order to get a 
saddle point, v~(xo) and v + (xq) must both be finite. Therefore the open loop 
lower value of the game will be finite if b) is verified and V (xo) ^ 0; the open 
loop upper value of the game will be finite if b) is verified and U(x o) 0. 

Example 6.2. Consider the utility function and linear dynamics 


C Xo (u, v) = / 2x 
Jo 


2 + u 2 — v 2 dt, 


x' = x + u + v, x(0) = xq (6.43) 


given by P. Zhang [1]. Here A = B\ = B 2 = 1, F = 0, and Q = 2. Now 
R = B\Bl — B 2 B 2 = 0 and the associated Riccati differential equation (6.40) 
reduces to 


P' + 2P + 2 = 0 in [0,1], P(1) = 0. 

It has a unique infinitely differentiable solution P(t) = e 2 *' 1- ^ — 1 that is 
strictly positive in [0,1). 

We now extend the result of P. Zhang [1] on the nonexistence of an open 
loop saddle point from the initial state Xo = 0 to any initial state. For all 
xo € K. the open loop lower value x _ (xo) of the game is finite, but the open 
loop upper value i> + (xo) is + 00 . Indeed for each v € L 2 (0,T;M) 

/*1 

inf C Xo (u,v)<C Xo (-v,v)= 2 {xo e 1 ) 2 dt = (e 2 - l) (xof 

mSL 2 (0,T;R) Jo 7 

=> V~(x 0 ) = sup inf Cx 0 (u, v) < (e 2 - l) (x 0 ) 2 . 

t)€L 2 (0,T;l) MeL 2 (0,T;R) 


By definition of the sup, 


V (x 0 ) 


sup inf 

ueL 2 (0,T;R) ueL 2 (0,T;R) 


C Xo (u,v) 


> inf C Xn (u, 0) = inf [ 2x 2 + u 2 dt > 0 

uei 2 (0,T;R) M ei 2 (0,T;R) J Q 

=> Vxq el, 0 < v~(xq) < (e 2 — l) (xq) 2 . 


For the open loop upper value, associate with each u € L 2 (0,T;R) the se¬ 
quence of functions v n (t) = —u(t) + n, n > 1. The corresponding sequence of 
states is 
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and utility functions 


C Xo (u, v n ) = n 2 f 2(e* — l) 2 — 1 dt + 2n ( u(t ) dt 
Jo Jo 

+ f (e t xo) 2 dt + 2nxo ( e* (e 4 — 1 )dt 

Jo Jo 

= n 2 f 1 + 2e 2t — 4e 4 dt + 2 n f u(t) dt 
Jo Jo 

+ f (e t xo) 2 dt + 2nxo (e — l) 2 
Jo 

> (e — 2) 2 ?z 2 + 2 n xo (e — l) 2 + / u(t) dt 

Jo 


( e t xo) 2 dt 


=> sup C Xo (u,v) > C Xo (u, v n ) —» +oo 

wSL 2 (0,T;R) 

as n goes to infinity. Therefore for all xq G K" and all u G L 2 (0,T;R), 
sup C Xo (u,v) = +oo =>■ t> + (:ro) = +oo and U(x o) = 0, 

wei 2 (0,T;R) 

and there is no open loop saddle point. □ 


6.7 The general case of Remark 2.1 

It is interesting to look at the feedback strategies in the case of the general 
utility function with mixed terms (2.4) of Remark 2.1. With the change of 
variable (2.5) 


X 


1 

0 

0 

1 _ 


X 

u 

= 

-N^S* TV” 1/2 0 


u 

V 


N 2 x T* 0 TV” 1/2 


V 


and the matrices A, B i, B 2 , and Q, the matrix function P is the unique 
solution of the Riccati differential equation 

P' + PA +A*P-PRP+ Q = 0 a.e. in [0,T], P{T) = F, (6.44) 
where R = B\B X — B 2 B 2 and the feedback strategies are given by 

u = —B\Px and v = B* 2 Px (6.45) 

that yields in terms of the original variables 

u = -N- 1 [S* + B{P] x and v = TV" 1 [T* + B* 2 P] x (6.46) 
and the closed loop system 

f x' = [A - BiiVf 1 (S* + B\\P) + B 2 N 2 1 (T* + B*P)\ x 
\ =[A- BxN^BlP + B 2 N 2 1 B* 2 P] x, 

{ a-(O) = x 0 . 


(6.47) 
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7 Riccati differential equation and open/closed loop 
upper/lower value of the game 

In the literature, an important issue is the connection between the existence 
of a symmetrical solution to the matrix Riccati differential equation 

P' + PA + A*P- PRP + Q = 0 a.e. in [0,T], P(T) = F, (7.1) 

where R = BiB^ — B 2 B 2 , in relation with the existence of either an open or a 
closed loop lower value, upper value, or saddle point of the game. For instance, 
in the closed loop case, quoting P. Bernhard [2] in his introduction 

“It has long been known that, for the two-person, zero-sum differential 
game with linear dynamics, quadratic payoff, fixed end-time, and free 
end-state ( standard LQ game), the existence of a solution to a Riccati 
equation is a sufficient condition for the existence of a saddle point 
within the class of instantaneous state feedback strategies (Refs. 1-2), 
and therefore within any wider class (Ref. 3).” 3 

In the open loop case, the above statements are incomplete (cf. Exam¬ 
ple 6.2), even under the assumptions 

F > 0 and Q(t) > 0 a.e. in [0,T] 

used in P. Bernhard [2] that necessarily imply the convexity and the coer- 
civity of C Xo ( u , v) with respect to u and V(xo) = L 2 ( 0, T ; R fe ) for all Xo eR". 
Even when the solution of the Riccati differential equation (7.1) is H 1 ( 0, T) or 
bounded (Remark 6.3 and Example 6.2), it is also necessary that the utility 
function be convex in u and concave in v (Theorem 6.6). In fact, the existence 
of a strictly positive and infinitely differentiable solution to the Riccati differ¬ 
ential equation (7.1) does not even imply that either the open loop lower value 
or the open loop upper value of the game be finite as shown in Example 7.2 
below. 

This leaves the cases where either the open loop lower or the upper value 
of the game explodes. In such cases, the solution of the Riccati differential 
equation might have a blow-up time as illustrated in Example 7.1 below (cf. 
P. Bernhard [2], Example 5.1, page 67) 

“The following game has a saddle point that survives a conjugate point.” 

where he means a closed loop-closed loop saddle point. The conjugate point 
corresponds to a blow-up time of the solution of the Riccati equation (7.1) 
where the solution is not of the if 1 (0, T)-type. Finally an open loop saddle 
point yields closed loop optimal strategies that achieve a closed loop-closed 
loop saddle point in the sense of P. Bernhard [2] (Theorem 6.5), but the 
converse is not necessarily true. It is informative to detail the example of P. 
Bernhard. 

3 Ref. 1 is Y. Ho, A.E. Bryson, and S. Baron [1], Ref. 2 is P. Faurre [1], and 
Ref. 3 is P. Bernhard [1]. 
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Example 7.1. Consider the dynamics and utility function in the time interval 

[ 0 , 2 ] 


x'(t) = (2 — t) u(t) + t v(t), a.e. in [0,2], x(0) = xq, (7.2) 

C Xo (u,v) = \\x(2)\ 2 + \u(t)\ 2 -\v{t)\ 2 dt. (7.3) 

Here A = 0, Bi(t) = 2 — t, B 2 (t) = t, F = 1/2, Q = 0, and R = B\B{ — 
B 2 B 2 = 4(1 — t). It is shown in P. Bernhard [2] that the Riccati equation 
reduces to 

P’ - 4(1 - t)P 2 = 0, P( 2) = 1/2 =» P(t) = 2{t l _ l)2 - 

Its solution is positive and blows up at t = 1. It is not an element of H 1 ( 0, 2). 
We now show that there is no open loop saddle point in the time interval [0,2]. 
For the open loop lower value of the game, the minimization with respect to 
u has a unique solution for all (cco, v ) since the utility function u i—> C Xo ( u, v ) 
is convex and bounded below by — The minimizer is completely char¬ 

acterized by the coupled system 


x'(t) = (2 — t) u(t) +tv(t) a.e. in [0, 2], x(0) = xq, 


p'(t) = 0 a.e. in [0, 2], 

u(t) = -(2 - t)p(t). 


P ( 2 ) = 2 a; ( 2 )’ 


From this 


z(2) = | 


f 2 

x 0 + / sv(s)ds 
Jo 


and p{t) = 2 ‘ c ( 2 ) 


and 


def 




= C X0 (u,v) = ^x(2) 2 + jx(2) 2 J (2 -t) 2 dt-J \v{t)\ 2 dt 

— -x(2) 2 — [ \v(t)\ 2 dt = — Xo + [ sv(s)ds — [ \v(t)\ 2 dt. 

6 Jo 14 L Jo J Jo 


It is readily seen that J Xo is concave in v and that the supremum with respect 
to v of J~ Q (v) exists. Indeed, from the first order condition 


Vu > \ dJ x 0 i^v) = ^ 


f 2 . 1 /' 2 [ 2 . 

xq+ sv(s)ds / sv(s)ds — / v(t) v(t) dt = 0 , 
Jo . Jo Jo 


there is a unique stationary point v(t) =tx o/2, the Hessian is negative 
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1 3 

2 d J x 0 (v;v,v) = — 


LJo 


< 


14 


sv(s) ds 


s 2 ds 


|rj(t)| 2 dt 


|u(s)| 2 ds 


< 


3 2 3 

i 4 y 


\v (f)| 2 dt 


-1 [ \v(t)\ 2 dt = ~ j \v(t)\ 2 dt < 0, 

. Jo ‘Jo 


and the open loop lower value of the game is v~(xq) = J xg (v) = (to) 2 /2. 

However the open loop upper value of the game is t + (to) = +oo for all 
xo £ R. Indeed pick the sequence of controls {r>„}, n > 1, v n (t) = 0 in [0,1] 
and v n (t) = n in [1,2]. The corresponding sequence of states at time t = 2 is 

t„(2)=to + f (2 — t)u(t)dt + n f tdt= xo + f (2 — t)u(t)dt 
Jo J l L Jo 

Denote by X the square bracket that does not depend on n. Then 

2 r 2 „ r 2 n 
+ J \u{t)\ 2 dt — j n 2 dt 


C'X0 ( U J ' 


x + l n 


= —n‘ 


3 X 2 f 2 

+ -nX + — —h / [u(t)\ 2 dt —> +oo as n —> +oo. 
2 2 J 0 


Thus for all .To € R and u £ L 2 ( 0, T; ] 
sup C Xo (u, v) = +oo => 

wei 2 (0,T;R) 


f' + (a;o) = +oo and U(xq) = 0. 


Therefore, whatever is the initial state To, C Xo (u,v) has no open loop saddle 
point. □ 

By changing the weight F = 1/2 to 1/3 in the final term F t( 2) 2 in the 
utility function of the above Example 7.1, we get an example of a convex 
coercive utility function with respect to u for which there is an infinitely 
differentiable positive solution to the Riccati differential equation (7.1), but 
the open loop upper and lower values are both equal to +oo. 

Example 7.2. Consider the state equation (7.2) with the new utility function 

C X0 (u,v) = ^|t(2)| 2 + \u(t)\ 2 - \v(t)\ 2 dt. (7.4) 

The Riccati differential equation (7.1) reduces to 

P'- 4(1 - t)P 2 = 0 in [0,2], P(2) = 1/3 => P(t) = ^ _ 1 - j 

and its solution is unique, strictly positive, and infinitely differentiable. Feed¬ 
backs of the form u = —B{Px and v = B^Px would yield C Xo (u,v) = 
P(0)tq = Tq/3. 
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As in Example 7.1, the utility function (7.4) is both convex and coercive 
in the first variable u. Therefore, given v, there exists a unique solution u to 
the minimization of C Xo (u,v) with respect to u and 


j x o 0) d = „ inf „ (u,v) 


u€L 2 ( 0,2;I 

= C Xo (u,v ) = 3 


2 -I 2 2 

Xo+ sv(s)ds — / \v(t)\ 2 dt. 

Jo J Jo 


It is readily seen that J~ 0 is not concave in v and that the supremum with 
respect to v of J Xo (v) is +oo. Indeed, pick the sequence v n (t) = n and let n 
go to +oo 


Jx 0 ( Vn ) = 10 n 2 + 12 n a’o + 3a;g —> +oo. 

Therefore, the open loop lower value v~(xo) and, a fortiori, the open loop 
upper value u + (a;o) are both equal to +oo. 

Finally, it is interesting to note that the corresponding coupled system on 

[ 0 , 2 ] 


j x' = [-(2 - t) 2 + t 2 ] p in [0,2], 

| x(0) = x 0 , 

has a uniciue solution given by 


p' = Oin [0,2], 
P ( 2 ) = ^(2), 


x(t) = [2(t- l) 2 + l] y, p{t) = ^x Q. 


So what is missing to get a finite open loop lower value is the concavity of the 
function v i—> J~ (v). □ 



Part II 


Representation of Infinite Dimensional Linear 

Control Dynamical Systems 





Semigroups of Operators and Interpolation 


1 Notation 


We shall denote by X a complex Banach space of norm | • |, and by C(X) 
the Banach algebra of all linear continuous mappings T: X —> X. The linear 
space £(X) is endowed with the usual norm: For any T € C{X) 

Ill’ll = sup {|Ta;| : x £ X,\x\ < 1}. (1.1) 

Given a set S C R, C(S\ X) will denote the set of all continuous mappings 
from S into X. For a closed bounded interval S = [a, b ], the space C([a, b\; X) 
endowed with the norm 


ll/llc([o,6];X) = SU P {|/(t)|: te [a, b}} (1.2) 

is a Banach space. The spaces of /c-times continuously differentiable mappings 
will be denoted by C k (S;X) and C k ([a, b]; X), k € N. 

L p (a , b; X) will be the Banach space of equivalent classes of strongly mea¬ 
surable (in the Bodmer sense) mappings [a, b] —> X that are p-integrable, 
1 < p < oo, (resp. essentially bounded, p = oo), with norm 


II/I|lp(o,6;X) — | J l/( s )| P| ^ s | J 

(resp. ||/||z,oo (ajb; .Y) = ess.sup{|/(f)|,f € [a, b]}). 


By W 1,p (a, b ; X) we shall denote the set of all mappings / in L p (a, 6; X) 
with a vector distributional derivative in L p (a,b; X). This derivative will be 
denoted df/dt or /'. For each / € VF 1,p (a, 6; X), there exists a unique abso¬ 
lutely continuous function /: [a, b] —> X such that / = / and f = f a.e. in 
[a, b\. Therefore we shall always identify / and /, which is the integral of its 
derivative. 
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A linear operator is a linear map A: D(A ) CX-*I defined on a domain 
D(A) that is assumed to be a linear subspace of X. The image or range of A 
is denoted i?(A). A linear operator is said to be closed if its graph 

G(A) = {( x,Ax ): x £ D(A)} 

is closed in the product space X x X. For a closed linear operator A, the graph 
norm operator topology of D(A) is defined by the norm 

M D(A) = M + \Ax\, x £ D(A). (1.4) 

When D(A) is endowed with the graph norm topology, it is a Banach space 
and A becomes a continuous linear operator from D(A) to X. 

Associate with the closed linear operator A the operators 

A\ = XI — A: D(A) —► X (1.5) 

for arbitrary complex numbers A. The resolvent set p(A) is the set of all 
complex numbers A such that the operator A\ has a bounded inverse 

R(X, A) = f [XI - A] -1 (1.6) 

in X. It is known that for closed linear operators A, A G p(A) if and only if 
R(X,A) exists and Im(A I — A) = X (cf. E. Hille and R. S. Phillips [1, 
Theorem 2.16.3, p. 55]). The complement of p(A) is called the spectrum of the 
operator A and is denoted by cr{A). The spectrum of A is made up of three 
disjoint parts: the continuous spectrum crc(A), which consists of all values of 
A such that A\ has an unbounded inverse whose domain is dense in X ; the 
residual spectrum <jr(A), which consists of all values of A such that A\ has 
an inverse whose domain is not dense in X; and the point spectrum <jp(A), 
which consists of all values of A for which no inverse exists. In other words: 

(i) A G ac(A) if A\ is one-to-one with a dense image in X not equal to X, 

(ii) A G ctr(A) if A\ is one-to-one, but its image is not dense in X, 

(iii) A G crp(A) if A\ is not one-to-one. 

2 Linear evolution equations and strongly continuous 
semigroups 

2.1 Definitions and preliminary results 

Let A: D(A) C X —■> X be a closed linear operator. Consider the initial value 
problem 


y'{t) = Ay(t), t > 0, 
y(0) = x, x £ X. 


( 2 . 1 ) 
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If A is bounded (that is A £ C(X)) the solution of problem (2.1) is given by 
the expression 

y(t) = e‘*x « £ *-±1. (2.2) 

k—0 

moreover, setting Sa (t) = e tA , the following properties hold: 


Vi, set, SA(t + s) = SA{t)SA(s), and 5a(0) =/. (2.3) 


There is a one-to-one correspondence between the abelian group (R, +) and 
the subset of transformations Sa = (5a(£) : t € R} in £(X) under composition 
“o”. So we shall say that ( Sa,° ) is a group and denote it {5a (i)} or simply 
Sa- Moreover the mapping 1 1 —> 5a (i): R —> £(X) is continuous. We say that 
5a is uniformly continuous. 

When A is unbounded it is still possible to construct a solution of (2.1) 
of the form y(t) = SA(t)x in specific applications. However, in general, 5 a (i) 
is only defined for t > 0 and (2.3) is only verified for t > 0 and s > 0 (as for 
parabolic problems). Thus we say that Sa is a semigroup. In addition, Sa is in 
general not uniformly continuous, but for each x € X, the function 1 1 —> SA{t)x 
is continuous. We say that Sa is strongly continuous. This naturally leads to 
the following definition, which will be followed by a characterization of the 
properties of the operator A, which generates the family of operators Sa- 

Definition 2.1. A mapping S: [0,+oo[ —» C(X) (resp. R —> C(X)) is said 
to be a strongly continuous semigroup (resp. group) on X if the following 
properties hold: 

(i) 5(0) = I, S(t + s) = 5(f)5(s), Vf, s > 0 (resp. Vt, s € R), 

(ii) for all x € X, S(-)x is continuous on [0, oo[ (resp. R). □ 

Remark 2.1. A strongly continuous semigroup (resp. group) on X is also re¬ 
ferred to as a semigroup (resp. group ) of class Co on X in the terminology of 
E. Hille and R. S. Phillips [1, Chapter X, §10.6, p. 321], □ 


Remark 2.2. Assume that 5 is a strongly continuous semigroup on X and 
that for all t > 0, 5(f) -1 exists in C(X). If Vx £ X, S(-)~ x x is continuous on 
[0, +oo [, then setting 


S(t) 


Sit)- 1 if f < 0, 
S(t) if t > 0, 


5 is a strongly continuous group. 


□ 


The infinitesimal generator A of 5 is the linear operator in X defined by 


D(A) = ■{ x £ X: such that the lim ^-\S(h)x — xl exists )■ , 
' h\o+ h l 1 1 

Ax = lim — [5(/i)x — x], Vx £ D(A). 
h\ o+ h l 1 


(2.4) 
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Proposition 2.1. Let S be a strongly continuous semigroup on X with infin¬ 
itesimal generator A. Then: 

(i) D(A) is dense in X, 

(ii) \/x G D(A), S(-)x G C' 1 ([0, oo[; X) n C([0, oo[; D{Afi) and 

— S(t)x = AS(t)x = S(t)Ax, t > 0. (2-5) 


(iii) A is closed. 
Proof, (i) Set 


1 1 r a ^-h 

Qh = —(S(h) — I) and M a hX = — / S(s)xds, a > 0, h > 0. 
h ' h J a 


Then 


lim M a h x = S(a)x and Qh,M o t = ~(M t h - M o h ). 
0+ t 


It follows that, for any x £ X, we have Mo,tX G D(A) and that 


AMqjX = —(S(t) — I)x, t > 0. 


Since lim ( ^ 0 + M 0>t x = x we see that D{A) is dense in X so that (i) is proved. 

(ii) If x € D(A) we have QhS(t)x = S(t)QhX —> Sit)Ax as h — > 0. Thus 
S(t)x G D(A) and AS(t)x = S(t)Ax. Let us now prove that S(-)x is right 
differentiable for x G D(A). If to > 0, and h > 0, we have 

— [5(to + h) — S'(to)®] = QhS{to)x —> AS{to)x as h —> 0. 


To prove the left differentiability, fix to > 0 and let h G ]0, to [- Then we have 
h)x — S(t 0 )x _ _ f^Q hX _ s{t 0 )Ax = AS{t 0 )x as h —> 0, 


where we have used the result that S(-)x is bounded on bounded subsets of 
[0, oo [ by the uniform boundedness theorem. The C ,1 -continuity with values 
in X and the continuity with values in D{A) follow from (2.5). Thus (ii) is 
proved. 

(iii) Consider a sequence {x n } C D(A) such that x n —> x G X and Ax n —> 
y G X. By (2.5) it follows that S(t)x n — x n = f* S(s)Ax n ds, so that, as n 
goes to infinity, S(t)x — x = f* S(s)y ds. Thus by dehnition of A, 


QtX 


S(s)yds—>y as t —> 0 and Ax = y. 


□ 
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Theorem 2.1. Let S be a strongly continuous semigroup on X with infinites¬ 
imal generator A. Then for each x in D(A), the system 

dx 

— (t) = Ax(t), t> 0, x(O) = x £ D(A) (2-6) 

has a unique solution x in C 1 ([0, oo[; X) n C([0, oo [; D(A )) and 

x(t) = S(t)x, \/t > 0. (2.7) 


Proof. The existence follows from Proposition 2.1. To prove uniqueness let v 
be another solution in C 1 ([0, oo[; X) fl C([0, oo[; D(A)) . Fix t > 0 and set 

z(s ) = S(t — s)v(s), s £ [0, t\. 


From Proposition 2.1 and the properties of 

v and z € C 1 ([0, oo[; X) fl C([0, oo[; D(A)), 
we have for all s in [0, t] 



—AS(t — s)v(s) + S(t 


. dv , . _. 

s )~r( s ) = s (t 

ds 


s) 


dv . . . , . 

— (s)-Av(s) 
ds 


= 0 . 


As a result z £ C' 1 ([0, t\;X) and z(s) = z(0) for all s £ [0,f]. This implies 
v(t) = z{t) = S{t)v( 0) = S{t)x for all t > 0. □ 


2.2 Asymptotic behavior of S(t) 

Let S' be a strongly continuous semigroup on X. Define 

^o(S) = inf i log ||S(t)||. (2.8) 

wo(S) is said to be the type of S. 

Proposition 2.2. The type loq = wo(S) of the semigroup S is finite or equal 
to —oo, and moreover, 


w 0 = lim jlog||S(t)||. (2.9) 

t —>oo t 

Proof. By definition u o is finite or — oo and 

w 0 < liminf j log ||S(t)||. 

t—> oo t 

So it is sufficient to show that 

limsup — log ||S(t)|| < w 0 . 
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For each u> > u>o, there exists t^ > 0 such that 

log 11 s'(on < u. 

Any t > 0 can be written in the form 

t = n(t)t u + r(t), n(t) G N, 0 < r(t) < t u . 

Then 

S{t) = S(n(t)t u + r(t)) = %) B(f >S(r(t)) 

and 

log||S(f)|| < n(t) log ||S(i w )|| + log||S(r(i)) ||. 

But ||S(t)|| is bounded on the compact interval [0,t w ] by some constant M > 0 
and 


log II£(1)11 < n(f)log||SO)|| + log M < log ||SQ)|| log M 

t ~ n(t)t u +r(t ) ~ t^ + r(t)/n(t) t 

z log||S(t w )|| log M log M 

O-1- LU -• 

t(jJ t t 

As t goes to oo, 

limsup - log ||S(£)|| < w. 
t—> oo t 

Since w > ojq is arbitrary and finite, the above inequality holds with u = u>q. 

□ 

Corollary 2.1. If S is a strongly continuous semigroup of type ujq, then, for 
any uj > loq, there exists M u > 1 such that 

\\S(t)\\<M u e wt , t> 0. (2.10) 

Proof. Choose t u as in the proof of Proposition 2.2 and set t = n(t)t u + r(t). 
If wo > 0, then to > wo > 0 and we have 

||S(f)|| < ||S(t w )||" (t) ||S(r(t)) || < M u exp(t a ,n(t)w) < M u e ut t 

where M u = sup{||S(s)||: s G [0, i w ]}. If wo < 0, then we consider the semi¬ 
group So(t) = e~ u} ° t S{t) for which the type is 0. So for each w > to o, ui—to o > 0 
and there exists M u > 1 such that 

e _ “ ot ||S(f)|| = ||e-“ 0 *S(t)|| < M u e^~ Uo)t , t > 0. 


This completes the proof. 


□ 
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Semigroups S of negative type can be completely characterized through the 
asymptotic behavior of their trajectories. This characterization was first intro¬ 
duced by R. Datko [2] in 1970 who extended the Lyapunov’s theorem from 
finite dimensional spaces to Hilbert spaces H and showed that exponential de¬ 
cay is equivalent to the fact that all trajectories belong to L 2 (0,oo\ H). This 
last result was generalized by A. Pazy [1] in 1972 from Hilbert spaces H to 
Banach spaces X and from L 2 -spaces to L p -spaces, 1 < p < oo. The simplified 
proof of (ii) => (iii) below is due to A. J. Pritchard and J. Zabczyk [1] 
in 1981. To our knowledge condition (v) was first given by A. BENSOUSSAN, 
M. C. Delfour, and S. K. Mitter [1] in 1976 (see also M. C. Delfour [7] 
in 1978). 

In the following we first give the general results in L p for an arbitrary 
Banach space X. Then we specialize to Hilbert spaces and introduce the 
Lyapunov’s operator equation. 

Theorem 2.2. Let S be a strongly continuous semigroup in a Banach space 
X and p £ [1, oo[ ; a real number. The following properties are equivalent: 

(i) the property 

pOO 

\/x € X, / \S(t)x\ p dt < oo-, (2-11) 

Jo 

(ii) there exists a constant c > 0 such that 

POO 

Vx£X, / \S(t)x\ p dt<c p \x\ p -, (2.12) 

Jo 

(iii) the type loq (S) of S verifies the condition 

co 0 (S) < 0; (2.13) 

(iv) there exists a > 0 and M > 1 such that 

\/x € X, \/t> 0, |<S'(i)a;| < Me~ at |x|; (2-14) 

(v) S is asymptotically stable in C(X), that is 

lim ||S(i)|| = 0. (2.15) 

t —►OO 

Corollary 2.2. Let {S(£)} be a strongly continuous semigroup of type lvo(S): 

(i) For all u> > wo(S), A — col is the infinitesimal generator of the exponen¬ 
tially stable semigroup {^(t)}, 

S u {t) =e- ut S(t), t> 0. 

(ii) For all x in X, there exists a unique element 

e~ ws S(s)xds G D(A) 



such that 


[A — coI]y = x. 
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In other words, for all co > u>o{S), the operator A — u>I: D(A) —> X has a 
bounded inverse and for all x in X 

e~ us S(s)xds = —[A — uil]~ 1 x = R(lo,A)x 

and R(lo,A)x is the Laplace transform of S(-)x. 

Remark 2.3. Statements (iii), (iv), and (v) are independent of p, 1 <p< oo. 
As a result (i) and (ii) are true for all p, 1 < p < oo, and conversely it is 
sufficient to establish (i) or (ii) for some p, 1 < p < oo, to obtain (iii), (iv), 
and (v). □ 

Remark 2.4. In infinite dimension asymptotic stability, 

\/x € X, S(t)x —> 0 as t —* oo 

does not imply exponential stability. R. Datko [2] has given the following 
simple example for a group {5(f)} in the Hilbert space I 2 with a bounded 
infinitesimal generator A. Let H = I 2 , 

{ OO 

x = (xi,... ,x n ,...): y^x 2 < oo 
i= 1 

The group is 

(S(t)x) n = e~ t/n x n , n = 1,2,- 

It can be shown that 

\/x e £ 2 , S(t)x —> 0 as t —> oo, 

Vi, ||5(i)a:|| = 1 and loq (5) = 0, 

(Ax) n = ~ — , n = 1,2,..., D(A) = I 2 , 
n 

a(A) = |-i: n = 1,2,...| U{0}. 

□ 



Remark 2.5. Relaxations of conditions (2.11) from the p-th power of the norm 
in X to other functions can be found in several places in the literature. For 
instance J. Zabczyk [3, §5, Theorem 5.1 and Remark 5.2] used a continuous 
strictly increasing convex function N: [0, oo[ —> [0, oo[ such that iV(0) = 0, 
and the condition 

/»oo 

Vx £ X, 3a > 0, / N(a(\S(t)x\) dt < oo. 

Jo 


This condition implies condition (iv) in Theorem 2.2. In 1986 S. Rolewicz [1] 
generalized the above result to evolution operators and showed that the con¬ 
vexity assumption can be dropped. It seems that this result was independently 
re-discovered in 1987 in L. Markus [1] and W. Littman [1], □ 
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Remark 2.6. For p, 1 < p < oo, and a strongly continuous semigroup S of 
negative type 

\/xgD(A), S(-)x € W 1,p ( 0, oo; X) n L p (0, oo; D(A)). (2.16) 

□ 

Proof of Theorem 2.2. (i) => (ii). Define for each integer k > 1, the set 

U k = ^xeX: J \S{t)x\ p dt<k 

By hypothesis X = IJ^ U k and because X is a complete metric space 

3k 0 > 0, 3xo G Uk 0 , 3r 0 > 0 such that B(x 0 ,r 0 ) C £4 0 , 

where B(xo,ro) is the ball of center Xq and radius ro (cf., for instance, 
J. Horvath [1, Corollary to Baire’s theorem, p. 62], Hence 

\S(t)(x 0 +y)\ p dt < k%, Vy £ B(0,r 0 ), 

and for all y in B(0, ?’ 0 ) 

ll'S'( - )2/IIZ/P(0,oo;X) < II 'S'(') (^0 + ?/) || Lp( 0 ,oo;X) + ||'S'(’)( a; o) ||lp( 0 ,oo;X) < 2 k 0 . 

So for all x in X, x yf 0, we can apply the above inequality to y = r<yx/\x\ and 

I|5(-)*|Up(0,oo;X) < 

(ii) => (iii). We know that for all lo > ojq there exists M > 1 such that 
Vt > 0, Vx e X, |S(t)x| < Me ut \x\. 

Choose u> > nrax{l,wo} 



1 

pu 


(1 — e~ put )\S(t)x\ p = [ e~ pur \S(t)x\ p dr 

Jo 

ft fOO 

= e- p n\S(r)\\ p \S(t-r)x\ p dr<M p / \S{t)x\ p dt. < M p c p \x\ 

J o Jo 


As a result 

Vi > 0, |S(i)x|* < l P “_ pujt M p c p \x\ p . 

Fix T > 0. As ||/S'(t)|| is bounded on any compact interval [0,T], T > 0, and 
lo > 0, then 

3A" > 0 such that Vt > 0, |S(t)x| < K\x\, 
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where 

K = max |max{||S(£)||: 0 < t < T},Mc \pui/( 1 — e _p “ jT )] 1 ^ P | . 

As K is independent of x, we have ||S(t)|| < K for all t > 0. 

We now use a second estimate for t > 0 

t\S(t)x\ p = f \S(t)x\ p dr< [ \\S(r)\\ p \S(t-r)x\ p dr<K p c p \x\ p , 

Jo Jo 

which yields for all t > 0 

mm < Kct- 1 '*. 

But by definition of u>q as an infimum over t > 0 

Vt > 0 , i log ||-S'(t) || > w 0 

and necessarily 

Vt > 0, e“°‘ < ||5(t)|| < Kct~ 1/p . 

But this only holds for w 0 < 0. 

(iii) => (iv). It is sufficient to choose a = 1 when to q = —oo and a = — 5 W 0 
when ojq is finite. 

(iv) => (i) and (iv) ==> (v) are obvious. To complete the proof we prove 
that (v) ==> (iv). By definition of to 0 

Vt > 0, ||5(t)|| > e“ ot . 

But by hypothesis S(t) —> 0 as t goes to 00 and necessarily 
0= lim ||jS'(t)|| > lim e“ ot , 

t—> OO t—> OO 

which in turn implies that ojq < 0 . □ 

We now prove the corollary. 

Proof of Corollary 2.2. Notice that the type u/oiSu) = a>o — < 0. So from 

the equivalence between (i) and (iii) in Theorem 2.2 

\/x£X, S u (-)x G L 1 (0, 00 ; A) 


and 


ft /»oo 

y(t) = — S u (s)xds —> y = — / S ul (s)xds in X 

Jo Jo 

as t goes to + 00 . Consider the expression 

POO POO 

S u (t)y — y = —Suj(t) / S UJ (s)xds+ / S i0 (s)xds 
Jo Jo 

pOO pOO 

— — I + s)x ds + / S cu (s)xds 

Jo Jo 

pOO pOO pt 

— — I Suj(s)xds-\- / Suj(s)xds = / S UJ (s)x ds 

Jt Jo Jo 
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and 


lim 

o 


Sco(t)y - y 
t 


= X. 


Therefore 

y £ D{A) and [A — ul]y = x. 

So A — ujI : D(A) —» X is onto. To show that it is one-to-one, consider y £ 
D(A) such that [A — ul)y = 0. Then 


^S u (t)y = S u (t)[A - u>I]y = 0, Vi > 0 
and this means that there exists a constant c £ X such that 


Vi > 0, S u (t)y = c. 

But {S'w(i)} is exponentially stable and 

c = y = S w (0)y = lim S u (t)y = 0 => y = 0. 

t—>oo 

This completes the proof. □ 

A. Pazy [1] pointed out that for semigroups of negative type the quantity 

14, = || S(-)®|| tP(0)OO; x) (2.17) 

defines a norm on X and that the property 

3c >0, Vx £ X , |4 < c|x| (2-18) 

defines a continuous embedding of X into L p ( 0, oo; X). So it is natural to ask 
when are the two norms equivalent. 

Theorem 2.3 (A. Pazy [1]). Let X be a Banach space, p, 1 < p < oo, a real 
number and S(-) a semigroup of negative type. Then the following conditions 
are equivalent: 

(i) the norms \ ■ \ and \ ■ \ p are equivalent on X, that is, 

3 m > 0 such that \x\ p > m\x\\ 

(ii) the condition 

3f 0 >0, 3c > 0 such that \/x £ X, |5(fo)a;| > c|ar|. 

Proof, (i) => (ii). For all x in X and t > 0 

/»00 ft f OO 

m p \x\ p < / \S(r)x\ p dr < / \S(r)x\ p dr + / \S(t + r)x\ p dr 

Jo Jo Jo 

< f \\S{r)\\ p \x\ p dr + (?\S(t)x\ p 
Jo 

<tM p \x\ p + c p \S(t)x\ p . 



98 


II-1 Semigroups of Operators and Interpolation 


Choose to = m p /2M P and c = m/2c. 

(ii) => (i). Use the identity 

to \S(to)x\ p = [ I S(t 0 -t)S(t)x\ p dt 
Jo 

I ‘OO 

< max||S(i)|| 1 ’ J \S(t)x\ p dt < M p c p \x\ p 

and 

A x \ < |S(i 0 )a;| < □ 

*o 

Remark 2.7. When condition (ii) is verified for some to > 0, it is also verified 
for all t in [0, to]. Indeed 

c\x\ < |5(to)or| = |5(to — t)S(t)x\ < M\S(t)x\. 

Any t > 0 can be decomposed as 

t = nto + r, n an integer and 0 < r < to ■ 

Then 

|5(t)s| = |S'(t 0 )"S'(r)a;| > c n \S(r)x\ > c n+1 \x\. □ 

Corollary 2.3. Assume that the hypotheses of the previous theorem are veri¬ 
fied, that S is of negative type and that for all t > 0 the image ImS'(t) of S(t) 
is dense in X. Then \ • \ p defines a norm equivalent to the norm \ ■ \ on X 
if and only if the semigroup S on X has an extension to a group of bounded 
operators on X. 


Theorem 2.4. Let X = H be a Hilbert space with inner product (•, ■), and let 
S be a strongly continuous semigroup on H with infinitesimal generator A. 
Then each statement in the Theorem 2.2 is equivalent to: 

(vi) there exists a positive symmetric operator P € C(H) such that 

Vx, y € D(A), (PAx, y) + (Px, Ay) + (x, y) = 0. (2.19) 

Proof. It is sufficient to show that (i) with p = 2 implies (vi) and that (vi) 
implies (ii) with p = 2. 

(i) =>• (vi). For all t > 0 and x and y in H define 

pt POO 

( P(t)x,y)= / (S(r)x, S(r)y) dr , (Px,y) = / (S(r)x,S(r)y) dr. 

Jo Jo 

By hypothesis P and Pit) are well-defined elements of C{H). In addition they 
are symmetric and positive. Moreover since (i) => (ii) 
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\{{P-P(t))x,y)\ = 


( S(r)x, S(r)y) dr 


< ll'S'(-)a;||L2( t>oo;ff )||5'(-)2/||L2 (t>oo;ff) < c\y\ \\S(-)x\\L 2 (t, oo; H) 

and, as t goes to oo, P(t)x —> Px in H for each x in H. 

For all x and y in D(A) 

(P(t)Ax,y) + (P(t)x,Ay) = f {(S(r)Ax,S(r)y) + (S(r)x,S(r)Ay)}dr 

Jo 

= j ^j-(S(r)x,S(r)y) dr = (S(t)x, S(t)y)- (x, y). 

Therefore for y = x 

lim |<S'(t)a;| 2 = \x\ 2 + ( PAx,x ) + ( Px,Ax ). 

t—*oo 

But 

POO 

/ |S'(t)a;| 2 dt < oo => liminf \S(t)x\ 2 = 0 

Jo 

and because the limit exists it coincides with its lim inf and 
\/x € D(A), lim |5(t)a;| = 0. 

t —►OO 

We now go back to our previous computation for x and y 

(■ P(t)Ax,y) + ( P(t)x,Ay) = (S(t)x, S(t)y) + (x,y) 

and let t go to +oo to obtain (vi). 

(vi) => (ii). For each x € D(A), S(t)x € D(A), Vt > 0, and 

( PAS(t)x , S(t)x) + ( PS(t)x , AS(t)x) + ( S(t)x, S(t)x) = 0 

or equivalently 

^-(PS(t)x,S(t)x) + |5(t)a;| 2 = 0. 
dt 

By integrating from 0 to T 

(PS(T)x, S(T)x) - (Px, x) = - f |5(t)x| 2 dt. 

Jo 

Since P is positive for all x € D(A) 


\S(t)x\ 2 dt < (Px, x) 


|5(t)a;| 2 dt < (Px, x) 


and we obtain (ii) for p = 2 with c = ||P||. By density of D(A) in H , the 
result also holds for all x in H. □ 
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Remark 2.8. Notice that in the Hilbertian case, it is not necessary to use 
Baire’s theorem to show (i) =>■ (ii). Instead we show that (i) ==> (vi) =>• (ii). 

□ 

Corollary 2.4. If P is a positive and symmetric solution of the Lyapunov 
equation in C(H), then 


\/x £ H, (Px, x) > (Px,x), 
where P in C(H) is defined as 


( 2 . 20 ) 


poo 

Vx,yeH, ( Px,y) = (S(t)x,S(t)y)dt. (2.21) 

J o 

Proof. For all x in D(A) we proceed as in the proof of the previous theorem 
and 

^-(PS(t)x,S(t)x) + |S(f):r| 2 = 0. 
dt 


Hence 


\S(t)x\ 2 dt < (Px,x) => (Px,x) = / \S(t)x\ 2 dt < \\P\\\x[ 


where the transformation P, as defined in the proof of Theorem 2.4, is well 
defined and for all x in D(A), (Px, x) < (Px,x). So by density of D(A) in H 
the corollary holds for all x in H. □ 


2.3 Spectral properties of the infinitesimal generator 

Proposition 2.3. Let S be a strongly continuous semigroup in X. Assume 
that there exist constants M > 0 and u> £ K. be such that 

||S(i)|| < Me ut , Vt > 0. (2.22) 

Then the infinitesimal generator A of S has the following properties: 

(i) Ccj = {X £ C: Re A > to} C p(A), 

(ii) for any A € C u the resolvent of A is given by 

pOO 

R(X,A)y= e~ xt S(t)y dt, y £ X. (2.23) 

Jo 

Proof. We have to show that, for any A £ C w and any y £ X, the equation 

Ax — Ax = y (2.24) 

has a unique solution given by x equal to the right-hand-side of (2.23). 
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Existence. 

For A £ C u and y £ X, x is well-defined as an elements of X by the right-hand 
side of (2.23). Then we have 

QhX = S(h)x — x) = ]-(e Xh — l)x — ye Xh [ e~ xt S(t)ydt. 
h h h J q 

As h —> 0, we find that QhX —> Ax and that the right-hand side goes to A x — y. 
Therefore Xx — y = Ax so that x € D(A) and a; is a solution of (2.24). 

Uniqueness. 

Let x £ D(A) be another solution of (2.24). Then we have 

t'°° d 

e~ Xt S(t)(\x — Ax) dt = — / — [e~ xt S{t)x] dt = x. 

Jo dt 

Thus x = x. □ 

2.4 Hille Yosida Miyadera Feller Phillips theorem 

We now give necessary and sufficient conditions on a linear operator A to 
be the infinitesimal generator of a strongly continuous semigroup. For early 
versions of this theorem, the reader is referred to E. FIille [2, p. 238] and 
K. Yosida [1] and for modern versions to W. Feller [1], I. Miyadera [1], 
and R. S. Phillips [1], 

Theorem 2.5. Let A: D(A) Cl-^I be a linear operator. Then the follow¬ 
ing statements are equivalent: 

(i) D(A) is dense in X, there exist real numbers M > 0 and ui £ M such 
that p(A) D {A £ C: Re A > w} and the following inequalities hold: 

||i? fc (A, A) || < M(Re A — oj)~ k , Vfc £ N, VA,ReA>w. (2.25) 

(ii) A is the infinitesimal generator of a strongly continuous semigroup S and 

there exist real numbers and Ad > 0 such that 

||5(t)|| < Me ut , Vf> 0. (2.26) 

Proof, (ii) => (i). From Proposition 2.3 {A £ C: Re A > cc} C p{A) and from 
formula (2.23) and inequality (2.26), we get condition (2.25) for k = 1. From 
Proposition 2.1, D{A) is dense in X and A is closed. By differentiating (2.23) 
k times with respect to A, we get 

f-OO 

RW(\,A)y = (-l) k t k e~ xt S(t)ydt, y £ X. 

Jo 
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It follows that 


||i? (fc) (A, A)|| <Mjfe!(ReA-w)- fc - 1 , k£ N. 

But from Proposition 2.3(ii) for all y £ X 

poo j.k f _i \k 

R k (X 1 A)y = ^' - e - Xt S(k)ydt = ^-R^(X,A)y 

and the conclusion follows. 

(i) => (ii). We proceed in four steps. 

Step 1. Construction of an approximate semigroup S n . 

For any integer n € N such that n > u>, we set 

Jn = nR(n, A), A n = AJ n (2.27) 

and recall that 

A n = n 2 R(n, A) — nl. 

The bounded operators A n are called the Yosida approximations of A. We 
claim that the following identities hold: 

lim J n x = x, x £ X, (2.28) 

n—>oo 

lim A n x = Ax, x £ D(A). (2.29) 

n—>oo 

We first prove (2.28). For x £ D(A), J n x — x = R(n,A)Ax —> 0 as n —> oo 
from (2.25). But || J n \\ < Mn(n — w)^ 1 is less than a constant and by density 
(2.28) is true for all x in X. Now (2.29) is an immediate consequence of (2.28) 
since A n x = J n Ax for any x £ D(A). We now set 

00 2 kj.k 

S n (t) = exp(C4„) = e~ nt ^ —R k {n, A). (2.30) 

k =0 

By (2.25) it follows that 

\\S n (t)\\ < Mexp(ntuj/(n — lj)) < Me 2uJt , if n > 2 lu, t > 0. (2.31) 

Step 2. Uniform convergence of S n (t)x to S(t)x for all x in X on compact 
intervals in [0, oo[. 

Fix x G X and set u n (t) = S n (t)x. Then, if n, m > lu, we have 

! ~jj (p^n ^m) = A n (u n %) (A n ^m)^mi 
{^m ^m) (0) — 0, 

'Unit) 'U'mit) — / exp((£ s)-Tn) exp(s^4 m )(A n A m )x ds, 

JO 
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and, using (2.31), the estimate 

\u n (t) — u m (t)\ < M 2 e 2tu t\A n x — A m x\, m,n> 2u (2.32) 

follows. In view of (2.29), for all x € D{A) {u n (t)} is a Cauchy sequence. But 
the same is true for any x £ X by virtue of (2.31). Thus the following limit 
exists: 

lim u n (t) = lim S n (t)x = u(t), x £ X, (2.33) 

n —kx> n—>oo 

uniformly in t on the bounded intervals of [0, oo[. Set now S[t)x = u(t). It is 
easy to check that S is a strongly continuous semigroup in X and that (2.26) 
holds. 

Step 3. If x € D(A), then S(-)x is differentiable and 

—S(t)x = S(t)Ax = AS{t)x. (2.34) 

In fact by (2.29) and (2.33) it follows that 

—u n (t) = exp (tA n )A n x —> S(t)Ax as n —> oo. 

Step 4. A is the infinitesimal generator of S. 

Let B be the infinitesimal generator of S. By (2.34) it follows that B is an 
extension of A. Then it is sufficient to prove that if x £ D(B) then x £ D(A). 
Let, in fact, x € D(B), Re A > w, and z = Xx — Bx. Then R(X,A)z € D(A) 
and 

(A - B)R{ A, A)z = (A - A)R( A, A)z = z 

so that 

x = R{\,B)z = R(\,A)zeD(A). □ 

2.5 Adjoint semigroups and their generators 

Given a semigroup of continuous linear transformations S(t), t > 0, on X, it 
is always possible to define the adjoint transformations S*(t), t > 0, on X' 
and it is easy to check that 

Vt > 0, Vs > 0, S*{t + s) =S*{t)S*(s), S*(0) = I, 

Vx* € X ', t —> S*(t)x* : [0, oo[ —> X' (weak) is continuous . 

We shall say that S* is the adjoint semigroup associated with S. However S* 
is not necessarily a strongly continuous semigroup on X. Fortunately we have 
the following result in reflexive Banach spaces. 

Proposition 2.4. If S is a strongly continuous semigroup on a reflexive Ba¬ 
nach space X, the adjoint semigroup S* is also a strongly continuous semi¬ 
group on X. 
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Proof. Let A be the infinitesimal generator of S and let A* be the adjoint 
operator of A. As D(A) is dense in X, R( A, A)* = R( A, A*) and p(A) = p{A*) 
(cf. E. Hille and R. S. Phillips [1, Theorem 2.6.5, p. 56]). For all A in p(A), 
R(X,A), and R(X,A*) are bounded and 

||tf(A,A*)|| £(x , ) = \\R(X,A*\\ C{x>) = ||R(A,A)|| £W . 

So if we can show that D(A*) is dense in A', all the estimates for A in Theo¬ 
rem 2.5 will be true for A* and we shall conclude that A* is the infinitesimal 
generator of a strongly continuous semigroup on X'. For x* in X' we construct 
the approximations x* n = nR(n , A*)x *, n > 1. For all x in X 

lim (x*,x) = lim (x* ,nR(n, A)x) = (x*,x). 

n —»oo n —»oo 

As X is reflexive we conclude that x* —> x* in X' (weak). But in a reflexive 
Banach space the strong closure D{A*) of D(A*) is weakly closed because 
D(A*) is a closed linear subspace of X'. So we have proved that D(A*) is 
(strongly) dense in X' because the strong and weak closures of D{A*) coincide 
(cf. K. Yosida [2, Theorem 11, p. 125]). □ 

2.6 Semigroups of contractions and dissipative operators 

A semigroup of contractions is a strongly continuous semigroup S such that 

||5(t)|| < 1, Vt>0. (2.35) 

If S is a semigroup of contractions, then condition (2.25) reduces to 

||i?(A,A)|| < -L VA, Re A > 0, (2.36) 

Re A 

because we can choose M = 1 and u> = 0. 

In this section we shall give another characterization of linear operators 
that generate semigroups of contractions. For this we need the definition of 
dissipative operators. 

We first recall that for any x £ X the sub-differential d\x\ is defined by 

d\x\ = {x' £ X': \x'\ = l,(x,x r ) = |x|}, (2.37) 

where X' is the topological dual of X. By the Hahn-Banach theorem, it follows 
that d\x\ is never empty. 

Definition 2.2. (i) We say that the linear operator A: D(A) C X —> X is 

dissipative if 

Vx € D(A), 3x' € d\x\ such that Re(Ax,x / ) < 0. 

(ii) The linear operator A: D{A) C X —> X is said to be maximal dissipative 
if it is dissipative and has no proper dissipative extension. □ 
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Proposition 2.5. Let A be the infinitesimal generator of a strongly continu¬ 
ous semigroup of contractions. Then A and its adjoint operator A* are maxi¬ 
mal dissipative. Moreover 

VAX), R{XI — A) = X and R{XI-A*)=X'. 

Proof. Let x G L>(A), x ' G <9|a;|, and h > 0. Then in view of (2.37) and (2.35) 
R e(S{h)x — x, x') = R e(S{h)x, x') — |tc| < 0 
since ||S'(h)|| < 1. It follows that 

R e(Ax,x') = Re lim — {{S{h)x — x,x')) < 0. 
h —*o ri 

By hypothesis, A is a closed densely defined linear operator on X. Hence its 
adjoint A* is a well-defined closed linear operator on X' with domain D(A*) 
(cf. E. Hille and R. S. Phillips [1, Theorem 2.11.8, p. 43]). But from (2.36) 
for all A > 0, A <E p(A), XI—A has a bounded inverse R( A, A), R(XI—A) = X, 
and 

\\R(X,A)\\ < i, VA > 0. 

As D(A) = X and XI — A has a linear bounded inverse, then 

R(XI - A*) = X’ 

(cf. E. Hille and R. S. Phillips [1, Theorem 2.11.15, p. 45]) and 

R{ A, A*) = (A/ - A*)- 1 = {XI - A)- 1 * = R{ A, A)* 

(cf. E. Hille and R. S. Phillips [1, Theorem 2.11.14, p. 44]). So for A > 0, 
XI — A* has a bounded inverse and 

||R(A, A*)|| = ||i?(A, A)*|| = \\R{X,A)\\ < I, VA > 0. 

Hence for all y* £ X' and A > 0 

\R(X,A*)y*\x' <\\y*\x>. 

For all a;* G D{A*) 

R(X, A*){XI — A*)x* = x* 
and for all x* G D{A*), A > 0 

\x*\x> < j\(XI-A*)x*\ x ,. 

The dissipativity of A* now follows from the following lemma. 
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Lemma 2.1 (A. Pazy [1, Theorem 4.2, p. 14]). A linear operator T is dis¬ 
sipative if and only if 

| (A/ — T)x\ > A|x|, \/x £ D(T), VA > 0. 

Finally both A and A* are maximal dissipative because in both cases 

VA > 0, A/ — A: D{A) —> X and XI — A*: D(A*) —> X' 

are bijective maps (one-to-one and onto). □ 

If A is maximal dissipative, it is generally not the generator of a strongly 
continuous semigroup since its domain is not necessarily dense (cf. A. Pazy [2, 
Example 4.7, p. 16-17]). Also if A is a dissipative closed densely defined op¬ 
erator that is not maximal, then it will not necessarily be a generator. A 
necessary and sufficient condition is given by the following theorem. 

Theorem 2.6 (G. Lumer and R. S. Phillips [1]). Let A: D(A) c X —» 
X be a linear operator defined on a Banach space X. A is the infinitesimal 
generator of a semigroup of contractions on X if and only if: 

(i) A is a closed linear operator with dense domain in X and 

(ii) A and its adjoint operator A* are dissipative. 

Proof. (<=) By Theorem 2.5 it is sufficient to prove that for any y £ X and 
for any A with Re A > 0 the equation 


Xx — Ax = y (2.38) 

has a unique solution and that the following estimate holds: 

(2-39) 

Now, since A is dissipative we easily obtain the following a priori estimate: 
there exists x' £ d\x\ such that 

Re A|x| = Re(Ax, x') = Re(Ax, x') + R e(y, x') 

< R e(y,x') < \y\. 

This proves the uniqueness of the solution of (2.38) as well as estimate (2.39). 
It remains to prove that (A — A)(D(A)) = X if Re A > 0. 

Step 1. (A — A)(D(A)) is dense in X if Re A > 0. 

Let x' £ X' and Re A > 0 such that (Xx — Ax,x') = 0 for any x £ D(A). 
We have (Ax, x') = X(x,x'), so that x 1 £ D(A*) and (x, Ax' — A*x') for any 
x £ D(A). Since D (A) is dense in X we have Ax' — A*x' = 0, which implies 
(by (2.39) with A replaced by A*) that x' = 0 so that (A — A)(D(A)) is dense 
in X. 
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Step 2. (X-A) (D(A)) = X if Re A > 0. 

Let Re A > 0 and y € X. Since (X — A) (D (A)) is dense in X there exists a 
sequence {x„} C D(A) such that y n = Xx n — Ax n —> y as n —» oo. By (2.39) 
it follows that 


— T-J A \£fn 

Re A 

so that {x„} is a Cauchy sequence. Hence there exists x € X such that x n —> x 
in X, Ax n = Xx n — y n —> Ax — y. Since A is closed we have x € D{A) and 
Ax — Ax = y. 

( =>■ ). The converse is true by Proposition 2.5. This completes the proof. 

□ 

In the last theorem the dissipativity of both A and A* are necessary to 
obtain a semigroup of contractions. This arises from the fact that in a Banach 
space a closed linear maximal dissipative operator A is not necessarily densely 
defined even when R(XI — A) = X for all A > 0. This difficulty disappears 
when X is a reflexive Banach space (cf. A. Pazy [2, Theorem 4.6, p. 16]) and 
we can restate Theorem 2.6 as follows. 

Theorem 2.7. Let A: D(A) C X —> X be a linear operator defined on a 
reflexive Banach space X. A is the infinitesimal generator of a semigroup of 
contractions on X if and only if: 

(i) A is dissipative, and 

(ii) 3Ao > 0 such that R(XqI — A) = X. 

Proof. ( => ). From Proposition 2.5 

{<=) By invoking Lemma 2.1, it is easy to show that for a linear dissipative 
operator, A is closed if and only if its range, R(XqI — A), is closed for some 
Ao > 0. Then from (ii) and (iii) by A. Pazy [2, Theorem 4.6, p. 16], D(A) = X. 
Finally the result follows from A. Pazy [2, Theorem 4.3a]. □ 

To complete the picture we also quote the Hilbert space version of the two 
previous theorems. 

Theorem 2.8 (R. S. Phillips [2, Theorem 1.1.3, p. 203]). Let A: D(A) C 
H —> H be a linear operator defined on a Hilbert space H. Then the following 
conditions are equivalent: 

(i) A is the infinitesimal generator of a semigroup of contractions on H\ 

(ii) A is maximal dissipative ; 

(iii) A* is maximal dissipative. 

In the above theorem we have made use of the fact that in a Hilbert space 
a maximal dissipative operator is closed (cf. H. Tanabe [1, Theorem 2.1.1, 
p. 20]). The original theorem proved by R. S. Phillips [2, Theorem 1.1.3, 
p. 203] used the conditions 

(ii) A is maximal dissipative and densely defined, 
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(iii) A* is maximal dissipative and densely defined, 
which are equivalent to 

(ii) A is closed and maximal dissipative, 

(iii) A* is closed and maximal dissipative. 

We complete this section with the important subclass of semigroups of 
contractions that preserve the norm 

Vai, Vf > 0, |5'(i)cc| = |x|. 

Theorem 2.9 (M. H. Stone [1]). Assume that X = H where H is a Hilbert 
space: 

(i) If A is a self-adjoint operator on H, then B = iA is the infinitesimal 
generator of a strongly continuous group of unitary transformations. 

(ii) Conversely if S(t) is a strongly continuous group of unitary transforma¬ 
tions with infinitesimal generator B, then iB is self-adjoint. 

Proof, (i) By definition of B 

R e(Bx,x) = Re(iAx,x) =0, Va: € D(A). 

It follows that the linear operators B and B* = ~B are dissipative. The 
conclusion follows from Theorem 2.6. 

(ii) Since S(t) is a unitary transformation 

\S(t)x\ 2 = |a:| 2 , (2.40) 

and if a: € D(B ), B the infinitesimal generator of S, then by differentiating 
(2.40) at t = 0 we have Re(f3a;, a:) = 0 so that 

Im(ii3a:, x) = Re(I3a:, a:) = 0 

and iB is self-adjoint. □ 

2.7 Analytic semigroups 

Assumption A Let A be a closed operator with dense domain D(A) in X. 
Assume that there exist and do, 7r/2 < 6o < tv, such that 

A-l. 

p{A) contains a sector 


Su,e 0 ={Ae€: A ^ u> and \ arg(A — w)| < 6>o}, 
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A-2. 


There exists M > 0 such that 



(2.41) 


Now define the operator 



e xt R( A, A) dX, t > 0, S(0) = /, (2.42) 


where is the path (oriented in the increasing direction of Im A) defined in 
the following way (see Figure 1.1): 



We notice that the integral in (2.42) is convergent because 9 > 7r/2; more¬ 
over it does not depend on the choice of e and 9 as can easily be checked by 
using the Cauchy theorem for holomorphic functions. 

Theorem 2.10 (E. Hille [1]). Let A be a closed linear operator in X with 
dense domain D(A) in X such that assumptions Al A2 are verified and let 
S be defined by (2.42). Then the following statements hold: 

(i) S is a strongly continuous semigroup with infinitesimal generator A. 



Inr A 


/ 


/ 


Fig. 1.1. Sector Sb,e 0 and path of integration 7 . 
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(ii) There exist M > 0, N > 0 such that 

\\S(t)\\<Me ut , \/t> 0, (2.43) 

|| (A - uI)S(t) || < je ut , Vt > 0, (2.44) 

S e c 1 (]0, oo [; C(X)) and S'(t) = AS(t), Vt > 0. (2.45) 

(iii) S has an analytic extension in a sector So,e 0 -n /2 and 

S(z) = — f e Xz R(X, A) dX, 

2m ^e,e+„/2 (2.46) 

z = pe l6 , 9 £ [0, 6*o — — [ and p > 0. 

Proof. We can assume that to = 0 (otherwise we change A to A — to I and S(t) 
to e~ u}t S(t)). The proof is divided into five steps. 

Step l.Se C 1 (]0,oo[;£(X)) and S'{t) = AS(t), t > 0. 

It is clear that, from (2.42), S is of class C°° in S Ut e 0 and that 


S'(t.) = J- [ Xe Xt R(X, A) dX 
2m 

= — f e xt dX + — f Ae xt R{ A, A) dX = AS{t) 
2m J 2m R 


because f e xt dX = 0. 

Step 2. There exist M > 0 and N > 0 such that ||S(f)|| < M, ||.A5(i)|| < N/t. 
Setting A t = £, (2.42) becomes 

S{t) = 'ki! t A ) ^ / eSR (€/t> A ) d t/t 


1 

27t i 


tle.e 
+oo 


exp(re* w )i?(re* y /t, A)e w dr/t 

/ +0O 

exp(re _ * e )i?(re _ie /t, A)e~ ie dr/t 


n6 


1-6 


exp (£e tr, )R(ee 111 /t, A)iee lv dij/t 


from which 


||S(i)||<_L | 2 jf Me rcos6 dr/r + J Me ecosri dp |, 
||5 , (t)|| < ^ | 2 £ Me rcos9 dr + £ J Me ecosr > dp j 
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as e —> 0, we obtain 


mm < 


M 

nt\ cos0|' 


Step 3. S is strongly continuous. 

As S(t) is bounded (by the second step), it is sufficient to prove that 
lim t ^ 0 S{t)x = x for any x £ D(A). Let x £ D{A) and set y = x — Ax. Then 
x = R( 1, A)y and we have 


S(t)x = S(t)R(l,A)y = — [ e xt R(X,A)R(l,A)ydX 

Jle,e 

d -k-hLf R(i ’ A)y 

-hS***'** 


dX 

l^A 


dX 

1 _ A' 


As t —> 0 we have 


lim S(t)x = ^—f R(X, A)y-^~ = R{l,A)y 
f\o 2m J 1 - A 


= x. 


Step 4. S(t + s) = S(t)S(s),t, s , > 0. 

We have 

S(t)S(s) = —t-j f e xt R(X, A) dX f e^ s R^L 1 A)dp, 

47r Jle.e •'tae.g' 

where O' £ \k/2, 9[. It follows, using the resolvent identity, that 



Fig. 1.2. Paths of integration -y e: e and y 2 e ,e'■ 
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T £ ,8X72e,0' 


^+^[R(\,A)-R(p,A)}^ 

fl — A 


~j e*R(\,A)i\! 

J 7e,0 J l2e,e' 


0 flS 


dfi 

/i — A 


+ A / d f = S(t + s ) 

4n ~ JK.» v~ x 


because 


1 

27ri 


oMS. 


72c, S' 


dp 

H — A 


= e xt and 


2-rri 


o xtJ x =0 

P — A 


Step 5. A is the infinitesimal generator of S. 

Let B be the infinitesimal generator of S. By the first step it follows that 
B is an extension of A. To prove that B = A we follow the same argument as 
for the fourth step of the proof of Theorem 2.5. 

Finally the proof of statement (iii) of the theorem is straightforward and 
it is left to the reader. 

□ 


Theorem 2.11. Let {S(t): t > 0} be a strongly continuous semigroup on X, 
A be its infinitesimal generator, and utl and M > 0 be such that 

||S(i)|| < Me“‘, Vt > 0. (2.47) 

Then the following statements are equivalents: 

(i) A verifies the following conditions: 

30o > p{A) D S ufio = {A G C: | arg(A - w)| < 0 O } (2.48) 

and 

3M>0, V0€]O,0 o [, ||l?(A,Al)|| < jA-T. VAGS^o. (2.49) 

(ii) The map 

1 1 —► S(t ): [0, oo[ —► £{X) (2.50) 

belongs to C 1 (]0, oo[; £(X)) and 

37V >0, Vt > 0, \\{A-u)I)S(t)e~ ut \\ < j. (2.51) 

(iii) S has an analytic extension in a sector So,e>, 0 < 8' < 7t/2 and e _ “ t S'(t) 
is bounded in every closed subsector of Sq,o' ■ 



2 Linear evolution equations and strongly continuous semigroups 113 


Proof. We have already shown in Theorem 2.8 that (i) => (ii). 

(ii) ==> (iii). Define G(t) = e~ UJt S(t) and B = A — u)I. By hypothesis G is 
differentiable and for all n > 1, 

= B n G(t) = [BG(t/n)] n = [G\t/n)} n , 

and G necessarily belongs to G°° (]0, oo[; C(X)) . Now from (2.51) 

||G (n) (t)\\ < n n N n t~ n 

and the series 

' n\ 

n =0 

converges in the disk 


C t = \z € C: \z-t\ < 


(2.52) 


because the coefficients a n = (nN/t) n /n\ are such that 

a n +i _ N '(n + 1)' n Ne 

ci^i t n t 

By the Principle of Identity for analytic functions, one sees that F is analytic 
in the sector £ 0 , 0 (sin# = 1/eN), which is the envelope of the disks C t , t > 0. 
As S is analytic in S o ,0 so is S(t) = e“*G(t). For any e, 0 < s < 8, it is now 
easy to show that F(z) is bounded in the closure of So,o-e and hence on any 
closed subsector of Sq, 9 - 

(iii) ==> (i). Again it is sufficient to prove that for u> = —e, £ > 0, there exists 
u£l and 9q, n/2 < 9 q < ir, for which assumptions A-l and A-2 are verified 
in the sector So,e 0 - The resolvent operator is given by the identity 

POO 

R(X, A) = e~ xt G(t) dt, VA, Re A > 0. 

Jo 

By hypothesis S(z) is analytic in a sector So,e for some 9, 0 < 9 < n/2. 
Consider the sector 


So,n+9/2 — |agC: \ y 0, 0 < argA < —-—| (2.53) 

and observe that for A = |A|e* Q in S'o,( 7 r+ 0)/2 (A y 0 and 0 < a < 9 + 7r/2) one 
can get R( A, A) by integrating along the line {te -3l G 4 : t > 0} 

R(X,A)= e~ xte ~ 3t S{te- 3ie/4 )e~ 3ie/4 dt (2.54) 

Jo 
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because that line is contained in the sector So,e- We know that S(z) is bounded 
in any subsector. Hence there exists M > 0 such that 

pOO 

\\R(X,A)\\< e~ tRe[Xe ~ 3ie/i] Mdt. (2.55) 

Jo 


But 


and 


P = Re[Ae- 3ie/4 ] 


|A| cos 


a 



0 7T 

-3 4 <a-3 4 < 2 



cos 


a — 3 — 
4 


> min 



A)>o. 


Therefore 

P Pi |A|A> > o 

and 

\\R(\,A)\\<^- VAGV+e/2, Im A > 0. 

By repeating the same construction for Im A < 0 with the line {te~ 3z6 ^ 4 : t > 
0}, we obtain the same inequality. Assumptions A-l and A-2 are then verified. 

□ 


Definition 2.3. A strongly continuous semigroup {S(t): t > 0} on X is said 
to be analytic if it verifies any one of the conditions of Theorem 2.9. □ 

The variational case (which will be studied in detail in Chapter 2) is the 
following situation. There exists a Hilbert space V such that 

V C H algebrically and topologically, and V is dense in H. (2.56) 

The space H is identified with its dual. So we cannot identify V', the dual of 
V, to V. On the other hand we have the sequence of embeddings 

V C H = H' c V\ (2.57) 

each space being dense in the next one, with continuous injection. We denote 
by (-, ■) the duality between V and V', and by || • || the norm in V (recall that 
| • j represents the norm and (•, •) the scalar product in H). 

Let a be a continuous bilinear form on V, which is V-H coercive 

3a > 0, 3/3 £ K., \/vGV, a(v,v) + /3|u| 2 > a||v|| 2 . 

Associate with a the operator A 

D(A) = {v GV: w i—> a(v,w) is iJ-continuous}, 

(Av, w) = —a(v, w), Vv € D(A), \/w e V. 


(2.58) 

(2.59) 
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In the variational literature it is customary to use —A instead of A. The choice 
that we have made in (2.59) is more in line with semigroup theory. 

We shall check that A generates an analytic semigroup and, thus, that 
there exists a unique classical solution of (2.1). Notice that the change of 
variable 

yp(t) = e~ 0t y(t) 

in the equation 

^ = Ay, y(0) = 2 / 0 , 

yields 

~m~ = (A--P i ) yp, 2//3(0) = 2/0 

and that 

((-A + /3I)v, v) v = a(v, v) + /3\v\ 2 > a||t>|| 2 . 

So it is sufficient to prove the result for (3 = 0. 

Theorem 2.12. Assume (2.58) holds; then A generates an analytic semi¬ 
group {S(t)| in H such that 

l|S(t)||<e^. (2.60) 

Proof. Cf. H. Tanabe [1, §5.4 and §3.6, Theorem 3.6.1]. □ 

2.8 Differentiable semigroups 

Definition 2.4. Let S' be a strongly continuous semigroup in X. We say that 
S is differentiable at to > 0 if the limit 

S'(t 0 ) = lim i(S(t 0 + h)~ S(t 0 )) (2.61) 

exists in C(X). □ 

Proposition 2.6. Let S be a strongly continuous semigroup with infinitesi¬ 
mal generator A. Assume that S is differentiable at to. Then the following 
statements hold: 

(i) S(to)x € D(A) for any x £ X and S'(to) = AS (to), 

(ii) S is differentiable at any t > to, 

(iii) for any n € N, S is n times differentiable at t > nto and 

S^ n \t)=A n S(t), t > nto- 
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Proof, (i) Due to Proposition 2.1 we have 

S'(to)x = AS(to)x for all x G D(A). 

Let now x € X and {x n } C D(A) be such that x n —■> x in X. As n —» oo we 
have 

AS(to)x n = S'{t 0 )x n —> S'(t 0 )x and S(t 0 )x n —> S(fo)z- 

As A is closed S(to)x € -D(A) and AS , (t 0 )a; = S'(to)x. 

(ii) For any t > to we have 


lim y(S(t.+h)—S(t)) = ^m—[S(to+h)—S(to)]S(t—to) = S'(t 0 )S(t—to). 

(iii) We only consider the case n = 2; the case n > 2 is treated analogously 
by recurrence. We have 

lim (S' , (2t 0 + h) - S'(2t 0 )) = lim AS(t 0 )^(S(t 0 + h) - S(2t 0 )) 

= AS (to) S'(to) = A 2 S(2t 0 ) 


and S( 2 \2to) = A 2 S(2to). For t > 2to we proceed as in part (ii). □ 

We shall now study some spectral properties of differentiable semigroups. 

Proposition 2.7 (A. Pazy [1]). Let S be a strongly continuous semigroup 
and assume that there exists a constant At > 0 such that for all t > 0, 
||jS'(t)|| < M. If S is differentiable at to > 0, then the resolvent set p(A) of its 
infinitesimal generator A contains the set 


S={ A G C: Re A < 0, | ImA|e toReA > 2||S , (i 0 )||}. 
Moreover there exists N > 0 such that 

||R(A,A)|| <7V(1 + |A|), AgA. 

Proof. For any t > to we set 

B\(t)x = f e x{t ~ s) S(s)xds, A G C, x G X. 

Jo 

We have 

B' x (t)x = S(t)x + A f e x< ' t ~ s ' > S(s)xds, 

Jo 

B\(t)( A — A)x = e xt x — S(t)x. 

By differentiating (2.66) with respect to t, we obtain 

B' x (t.)( A - A)x = Xe xt x - S'(t)x = Ae At I - \e~ Xt S'(t) 

A 


(2.62) 

(2.63) 

(2.64) 

(2.65) 

( 2 . 66 ) 


x. 


(2.67) 
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But if we choose t and A such that 


\ £ 


— A t Qf 


s\t) 


~ 2 ’ 


( 2 . 68 ) 


then [I — 1/Ae A *S"(f)] 1 exists and is bounded. From (2.67) and (2.65) 


R( A, A)x = — e Xi 
A 


i -l 


/ _ — r ~ xt Q ' 


s'(t) 




I — -e~ xt S'(t) 
A 


|^e xt S(t)x + J e Xs S(s)xds |. (2.69) 


The right-hand side of the above identity is bounded and we conclude that for 
t and A verifying (2.68) A € p{A). But for t = t 0 and A € E, (2.68) is verified. 
Hence £ C p(A). 

It remains to verify inequality (2.63). Set K = ||S"(to)||- For X G £ 


1 K 

— exp(-foReA) < 


(2.70) 


From (2.69) with t, = to 

2 M f to 

||-R(A, H)|| < —— exp(—1 0 Re A) + 2M / exp(— Re As) ds. 

I A I Jo 


But for all A £ £, Re A < 0 and 

||i?(A,.A)|| < 2Mexp(—t 0 ReA) 


w + f ° 
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Therefore from (2.70) we finally find 

\\R(X,A)\\ <MK[l + t 0 \X\}. 


□ 


We now prove the converse. 


Theorem 2.13 (A. Pazy [1]). Let A be the infinitesimal generator of a 
strongly continuous semigroup S for which there exists a constant M > 0 
such that, for all t > 0, ||iS(i)|| < M. Moreover assume that there exist three 
positive constants a, K, N , such that 


p(A) D A = {A G C: | Im A|e aReA > 2 K}, 
||E(A,A)|| < JV(1 + |A|), Aer. 


Then S is differentiable for t > 3a and we have for t > 2a 
3 3 


S(t) = ^2G i (t) = ^T f e xt R{\ 1 A)d \, 

i= 1 i =1 


where 7 j is defined by 

71 = {A G C: ImA = 2Ae" aReA }, 

72 = |ag C: A = 2Ke~ i6 , 9 G 

73 = {A G C: ImA = -2Ahr aReA }. 



(2.71) 

(2.72) 


(2.73) 


(2.74) 


Proof. Set 
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S(t)=ySi(t), Si(t) = [ e Xt R(\,A)d\, i = 1,2,3. (2.75) 

2lT * 

The integrals in (2.75) are meaningful for f > 2a. To check this for the first 
one, set A = x + iy. We have 

1 f“°° 

Si(i) = — / e tx+lty R(x + iy, A)(l - 2iKae ~ ax ) dx, (2.76) 

2tti J 0 

and for y = 2 Ke~ ax , we obtain 

||<Si(f)|| = 7 T- f °° e tx (l + \x\+2Kae- ax )dx i (2.77) 

27r Jo 

which is meaningful if t > 2a. 

Let us now show that Si(t) is differentiable for t > 3 a. In fact we have 

rl ~ 1 r~°° 

—Si(i) = — / (a: + 2ATe" aa: )e ta:+ ^ 

Clt Z7TZ ^q 

/?(* + 2Kie~ ax , A)(l - 2iKae~ ax ) dx (2.78) 

from which 

°°e te [l + N+2AT—] 

[|®| + 2Ke~ ax ][l + 2Kae~ ax ] dx, (2.79) 

which is meaningful for t > 3a. 

It remains to show that S = S. By a direct computation (using several 
times the argument employed to prove (2.62)) it is not difficult to check that 

S'(t)x = AS(t)x, for any x € D(A 3 ). 

As D(A 3 ) is dense in X, by the uniqueness of the solution of the Cauchy 
problem (cf. Proposition 2.6), it follows that S = S. □ 


2.9 Spectral determining growth condition 

Let A be the infinitesimal generator of a strongly continuous semigroup S of 
type u)q(S). We set 


S (A) 


sup{ReA: A £ a (A)}, if a(A) ^ 0, 
—oo, if cr(A) = 0. 


(2.80) 


If s(A) = u>o(S) we say that A verifies the spectral determining growth condi¬ 
tion or spectrum determined growth assumption. In this case, by the Corollary 
to Proposition 2.2, we can determine the asymptotic behavior of ||5(t)|| by 
the knowledge of the spectrum a (A) of A. 

We start with a general result. 



120 II-1 Semigroups of Operators and Interpolation 


Proposition 2.8. Let A be the infinitesimal generator of a strongly continu¬ 
ous semigroup {5(f)} on a Banach space X and let luo(S) denote the type of 
{5(f)}. Then 

Vi > 0, {e At : A G a(A)} C a(S(t )), (2.81) 

and 

s(H) < u> 0 (S). (2.82) 

Proof. Given an arbitrary A, consider the new semigroup 

S\(t)x = e~ Xt S(t) 

with infinitesimal generator A — XI. For all x G D(A ), 

[S(t) — e xt I]x = e At [S , A(t) — I\x, 

[S(t) — e Xt I]x = e Xt f S(r)e~ Xr [A ~ XI]x dr, (2.83) 

Jo 

[5(f) - e xt I]x = e xt [A - XI} f S{r)e~ Xr xdr. (2.84) 

Jo 

If A G ap(A), then [A — A/] is not one-to-one and necessarily, from (2.83), 
[5(f) — e xt I] is not one-to-one. Hence e xt G ap(S(t)), Vf > 0. If A G pr(A) U 
ac(A), then [A — A/] is one-to-one but R(A — XI) X and necessarily, from 
(2.84), R(\S{t)-e xt I}) ± X. So e At G a P (5(f)) Uctr (5(f)) Utr c (5(f)), Vi > 0. 
This proves (2.81). 

To verify (2.82), we use the spectral radius theorem 

lim ||5(1)”|| 1 /" = sup{|A|: A G <r(5(l))}. 

n—>oo 

In particular from (2.81) 

sup{|e A |: A G cr(H)} < sup{|A|: A G 5(1)} = lim ||5(n)|| 1 ^ n . 

n —>oo 

Note that |e A | = e ReA and that the direction of the above inequality is not 
changed by taking the In of both sides: 

s(H) = sup Re A < lim = w 0 (5). 

a &a(A) n ^°° n 

This proves (2.82) and concludes the proof of the proposition. □ 

In general inequality (2.82) is not true in the other direction except for 
special classes of semigroups. 

Proposition 2.9 (R. Triggiani [2]). Let S be an analytic semigroup. Then 
lo 0 {S) = s{A). 
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Proof. Assume that (2.41) holds and that wo (S) = 0. This is not a restriction 
because if wo(S) / 0 we can change S(t) to e~ Uo( - s ^ t S(t). Suppose now, by 
contradiction, that there exists e > 0 such that s(A) = —2e. By assumptions 
A-l and A-2 in Assumption A there exists 9 £ ] 7 t/ 2 , 7 t[ such that p(A) contains 
the sector S e ^/ 2 and by Cauchy’s theorem 

S{t) = — [ e xt R{ A, A) dX + — [ e xt R{ A, A) dX, 

27ti J 1+ 2m J 1 _ 


where 

7 ± = {AeC:A=-e + pe ±lri , p > 0 } 

and rj is chosen such that n/2 < rj < 8 and p(A) D Clearly ||i?(A, A)|| is 

bounded in the sector S— e _ TI , and moreover, its behavior at infinity is as 1/|A|. 
Now it is easy to check that ||5(t)|| < constant e~ et , which is a contradiction 
since coq(S) = 0 . □ 

The most general available results at the moment seem to be the following 
ones. 

Proposition 2.10. (i) If X is a Banach space and S is a strongly continu¬ 

ous semigroup that is eventually uniformly continuous, that is 

>0, 1 1 —> S(t): [to 5 oo[ —> C(X) is continuous , 


then s(A) = u>o (S). 

(ii) If X is a Banach lattice and S(to) is compact for some to > 0, then 
s(A) = w 0 (S). 

The proof of (i) can be found in G. Greiner and R. Nagel [1, p. 87] and 
the proof of (ii) in F. Neurander [1, p. 205]. 

Corollary 2.5. If X is a Banach space, the condition s(A) = ujq(S) is verified 
in any of the following situations: 

(i) A is bounded, 

(ii) 3to > 0 , 5(to) is compact, 

(iii) S is a differentiable semigroup, 

(iv) S is nilpotent, 

(v) S is analytic. 

Remark 2.9. The property s(A) = coo(S) was known for X a Hilbert space 
and A bounded (see I. Daleckii and M. Krein [1]). It was proved in 1975 
for analytic semigroups by R. Triggiani [2, comments following Proposi¬ 
tion 2 . 2 ] and for eventually compact semigroups (that is, there exists some 
to > 0 for which S(t) is compact for all t > to) by J. Zabczyk [2], This last 
result was a generalization of what was already known for delay systems (cf. 
J. K. Hale [2]). The generalization to semigroups that are eventually uni¬ 
formly continuous seems to be due to R. Nagel [1] and L. A. Monauni [1] 
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in 1980-1981. For other conditions using the spectral mapping theorem see 
E. Hille and R. S. Phillips [1, Section 16.7]. Several counterexamples are 
available (for instance E. Hille and R. S. Phillips [1, Section 23.16] where 
s(A) = —oo and u>o(S) is an arbitrary real number). This example is con¬ 
structed in an indirect way using fractional integration. Another example has 
been given by J. Zabczyk [2] where he shows that for any two real numbers 
a < b, one can construct a complex group S(t) with generator A such that 

s(A) = a < b = u>o(S). 

One question that remains open is to determine whether a similar example 
can be constructed for a real group or semigroup. □ 


2.10 Examples of semigroups 


2.10.1 Parabolic equations 


Let H be a Hilbert space and A a self-adjoint closed operator in H with dense 
domain D(A) in H. We assume that there exists w£l such that 

(Ax,x)<lo\x\ 2 , \/x € D(A). (2.85) 

By Lumer-Phillips’ theorem, A is the infinitesimal generator of a strongly 
continuous semigroup S in H such that 

\\S(t)\\ <e ut , t> 0. (2.86) 


Proposition 2.11. S is an analytic semigroup. 


Proof. First notice that, as A — ojI is self-adjoint negative, then a(A) C 
]—oo, w]. Then for any A € C\]—oo,w] and any y € H there exists x € D{A) 
such that 

\x — Ax = y. (2.87) 

Set A = lo + pe l6 . Then multiply the identity pe l6 x — (A — u)x = y by e~ l6 ^ 2 x 
and take the real part. We obtain 

cos ^\x \ 2 — cos ^((A — u>I)x,x) = T\.e[e~ l 6 ^ 2 {x, y)]. 


From (2.85) it follows that |a;| < (p cos 9/2) 1 |y| so that 


||R(A,A)|| < 


1 

|A — lo | cos0/2 


So pick a sector S u p 01 for some 9 0 , 7 t/2 < 9 0 < tt, and 9, 0 < 9 < 9q. Then 
cos( 0 / 2 ) > cos( 0 o/ 2 ) and 

ll^(A,A)|| < —- 1 m /9 , for all A in S U>0O . 

\X — (jj\ cos(^o/2) 

Thus S is an analytic semigroup. □ 
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Consider now an example. 

Let 12 be an open set of K™ with regular boundary <912. Consider the initial 
value problem for t > 0 



u(t, x) = 0, x £ <912, 
u(0, x) = uq(x), x £ fl, 


( 2 . 88 ) 


where cijk are real continuous functions in 12. Assume that there exists v > 0, 
such that (strong ellipticity) 

n 

]T ajkSjtk > v\i\\ £ € R". (2.89) 

j,k =i 

Set H = L 2 (12) and let A be the linear operator in H defined as 

D(A) = H 2 (Cl) n Hq(Q), 

, „ d ( . . d , .'l (2.90) 

{Au)(x)= y 

j,k= 1 v j y 

Then A is self-adjoint and hypothesis (2.85) is fulfilled with u> = Ao, where Ao 
is the first eigenvalue of A (see for instance S. Agmon [2]). 

By setting u(t) = u(t , •), problem (2.88) can be written as 

u = Au, u(0) = Uq 


and we can solve it by Proposition 2.1. We shall give details in §3 for a more 
general situation. 

Remark 2.10. If A is an elliptic operator of order 2m, with general boundary 
conditions, then, under suitable hypotheses, A generates an analytic semi¬ 
group (see S. Agmon [1]). □ 


2.10.2 Schrodinger equation 


Let 12 be as in the previous examples. Consider for t > 0 the problem 



u(t, x) = 0, x £ <912, 
u(0, x) = uq(x), x £ 12, 


(2.91) 
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then, setting B — iA (where A is defined by (2.90)), we can write problem 
(2.91) in the form 

u = Bu, it(0) = uq. (2.92) 

By Stone’s Theorem 2.9, B generates a contraction semigroup and problem 
(2.91) has a solution. 


2.10.3 Wave equation 


Let A be a strictly positive self-adjoint operator in the Hilbert space K. Con¬ 
sider the Hilbert space H = D(\fA) ® K and denote by 


Y = 


y 

yi 


the generic element of H. The inner product in H is defined by 
{Y,Z) h = (VAy, VAx) k + (yi,zi) K - 


(2.93) 


Let A be the linear operator in H defined as follows 


D(A)=D(A)®D(y/A), 


yi 


0 1' 

y 

r A y_ 


—A 0 

.2/1. 


(2.94) 


Proposition 2.12. A is the infinitesimal generator of a strongly continuous 
semigroup of contractions S on H , and S is given by 


S(t ) 


cos(vCTt ) A 1 / 2 sin(\/rii) 

— A 1 / 2 sin(v^At) cos(v4) 


(2.95) 


Moreover A* = — A. 

Finally assume that a {A) consists of a sequence {A*,} of eigenvalues and 
that {e k } is a corresponding complete orthonormal set of eigenvectors. Then 

we have _ _ 

<t(A) = {±iV aI}, AE% = ±i^E±, k G N, (2.96) 

where Ef = (e k ,±\/\k e k ). 

Proof Let Re A > 0, Y G H, then the equation XX — AX = Y is equivalent 
to the system 

J Ax - xi =y, 

|Axi + Ax = yi, 

whose solution is given by 


x = A(A 2 + A) 1 y + (A 2 + A) 1 y 1 , 
x\ = —ri(A 2 + A)~ 1 y + A(A 2 + A)~ 1 yi. 
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Thus A € p(A) and 

R(X, A) 


A(A 2 + A)- 1 (A2+71)- 1 
-A^ + A)- 1 A(A 2 +rl)- 1 


(2.97) 


Formula (2.95) and the identity — A = A* are easily verified as well as the last 
statement. □ 

We now give an example. Let f! be a bounded set of M" with regular 
boundary dfl, and let {cijk} be real continuously differentiable functions in Q 
such that (2.89) holds. Consider the following problem for t > 0: 


d 2 
dt 2 


i(t,x)= 'jh -^-^ajk(x)-^-u(t,x )|, x£fl, 


3,K=1 

u(t , x) = 0, x £ dfi, 
d 


u(0,x) = uq(x), —u(0,x) = ui(x), x € O. 
Let A be the linear operator in K = L 2 (0) defined by 

D(A) = H 2 (n)nH'{n), 


d 


(An){x) = - £ 


j,k-l 


d 

a j k {x)-Q-^-u(t,x) 


u(t,-) 

d , x 


Then A is self-adjoint and strictly positive. Setting 

U(t) = 

problem (2.98) is equivalent to 

U' = AU, U{ 0) = U 0 = 
and can be solved by Proposition 2.12. 


(2.98) 


(2.99) 


( 2 . 100 ) 


2.10.4 Delay equations 

Let C and D be given in £(C n ) and consider the problem 

z'(t) = Cz{t) + Dz(t — r), t > 0, 

2(0) = h 0 G C n , (2.101) 

z(9)=hi(0), a.e. 9 £ [—r, 0], 

where h\ € L 2 {—r , 0; C n ) and r > 0 is the delay. 
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Problem (2.101) can be easily solved in successive steps on each time in¬ 
terval of length r. We have 

(hi(t) 

z ( t ) = i etC,l0 + /o e ^~ s)C Dh!( s - t) ds 

I e( t - r ) c z(r) + J e^~ s)c Dz{s - r) ds 

and so on. 

We consider the Hilbert space H = C n x L 2 (—r, 0;C n ) and denote by 
h = (ho, hi) its generic element. We define a semigroup S on H by setting 

S(t)h = (z(t), z t ), h = (h 0 ,hi)eH, (2.103) 

where z is the solution of (2.101) and z t (9) = z(t + 9) for 6 G [—r, 0]. The 
semigroup properties S(t + s) = S(t)S(s), 5(0) = / are easily checked. 

Proposition 2.13. S is a strongly continuous semigroup in H that is differ¬ 
entiable for any t > r. The infinitesimal generator A of S is given by 

D(A) = {h = (ho,h 1 )€H:h 1 €W 1 ' 2 (-r,0-,C n ), h o = hi(0)} (2.104) 

Ah = (C7n(0) + Dhi(-r),h i) 

and we have 

cr(A) = {A € C: det(A -C- e~ Xr D) = 0}. (2.105) 


if t G [—r,0[, 

if f G [0, r], (2.102) 

if t G [r, 2 r], 


Proof. In several steps. 


Step 1. 5 is strongly continuous. 

For any h = (h 0 , hi) G H, we have S(t)h — h = ( z(t) — ho, z t — hi). But if 
—r<9<—t 

(zt-hi)(9) = hi(t + 6)-hi(0), 


and if 9 > — t 


rt+6 

(zt — hi)(9) = e^ t+e ^ c ho + / e^ t+e ~ 8 ' ,c Dhi(s — r)ds — hi (9). 

Jo 

Thus we can easily check that S(t)h —> h as t > 0. 

Step 2. S(t) is differentiable for t>r. 

Let t G [r, 2r], h = (h 0 , hi)-, then S(t)h = (z(t), z t ) where 

z(t) = e tc ho + [ e^~ s ^ c Dz(s — r) ds, 

Jo 

rt+0 

z t (9) = e {t+e)c ho + / e (t+e ~ s)c Dz(s - r) ds. 

Jo 
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It follows that S'(t)h = ( z'(t ), (zt)'), where 

z'{t) = Cz(t) + Dz(t — r), (zt)'(0) = Cz t (0) + Dz(t + 0 — r). 

Thus S is differentiable for t > r. 


Step 3. Let B be the infinitesimal generator of S(t). We first show that A C B. 
Indeed A is given by formula (2.104). 

Let h = (ho, hi) belong to the right-hand side of (2.104). Since hi € 
W 1,2 (— r, 0;C") and /ii(0) = ho = 2 ( 0 ), the new function 


’j(t) = 


z(t), 

hi(t), 


t e [o,T], 
t e [-r, 0] 


belongs to W 1,2 (—r, T; C"). For each t £ [0,T], let 


w t (0) = w(t + 8), 8e [—r,0]. 


Then 


S(t)h - h _ (w(t),w t ) - (h 0 , hi) 
t t 

w(t) — w(0) Wt — Wo 
t ’ t 
(v/(0),wf o ) = (Chi(0) +Dhi(-r),h'i) 

in C n x L 2 (—r, 0; C"). Hence we have proved that if h £ D(A) then (S(t)h — 
h)/t goes to Ah as t goes to 0, Therefore B D A. Finally we can check that 
for A sufficiently large, we have (A — A)(D(A)) = H so that A = B. 

Step 4. Equation (2.105) holds. 

It is sufficient to prove that A £ p(A ) if and only if the matrix 
A(X) = XI - C - e Ar D 

is invertible. The complex number A belongs to p(A) if and only if 

Vfc = (ko, ki) £ H, 3 h £ D(A), such that A h — Ah = k. (2.106) 


Given k = (ko, ki) £ H, the equation A h — Ah = k is equivalent to the system 

Xh 0 - Ch 0 - Dhi(-r) = k 0 , (2.107) 

Xhi-h'i=ki, hi(0)=h 0 . (2.108) 

This is also equivalent to 

r° 

hi(6) = e xe ho + / e x( ' 9 ~ s ^ki(s) ds, 9 £ [— r, 0], 

Je 

Xho — Ch.Q — Dhi(—r) = ko- 


(2.109) 
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By substituting the value of h\{—r) given by (2.109) in the last equation, we 
obtain 

r° 

(\-C-e~ Xr D)h 0 = ko + D e" A(r+s) fci(s)fis. (2.110) 

J —r 

Thus, if (2.106) is true, then for each k = ( ko , hi) in H , (2.110) has a unique 
solution ho . Therefore Zi(A) is invertible. Conversely if Z\(A) is invertible, then 
for each k there exists a unique ho given by (2.109) and a unique h\ given by 
(2.109) such that (2.106) be verified. □ 

The following corollary is an immediate consequence of Proposition 2.9. 

Corollary 2.6. The type of S is given by 

u 0 (S) = s(A)=sup{Re\: det(A - C - e~ Xr D) = 0}. (2.111) 

Remark 2.11. For more general examples and results for delay systems, see 
Chapter 4. □ 


3 Nonhomogeneous linear evolution equations 

3.1 Setting of the problem and definitions 

In this section A represents the infinitesimal generator of a 
semigroup S in X. We shall consider the following initial 

u'(t) = Au(t) + f(t), fe[0,T], 

w(0) = x, 

for x £ X and / £ T 1 (0 ,T;X) and approximations u n to 
by the following approximating initial value problem: 

u' n {t) = A n u n (t ) + /(f), 
u n ( 0) = x, 

where A n = n 2 R(n , A) — nI is the Yosida approximation of A. As A n € C(X), 
problem (3.2) has a unique solution given by 

u n (t) = e tAn x + f e ( ' t ~ s ^ An f(s) ds. (3.3) 

Jo 

We now give several definitions of a solution of problem (3.1) for x £ X 
and / £ L 1 ( 0,T;X). The concept of solution for rougher data (x,f) will be 
discussed in Chapters 2 and 3. 


strongly continuous 
value problem: 

(3.1) 

its solution u given 
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Definition 3.1. (i) u is a strict solution of problem (3.1) in L p (0,T; X) if u 
belongs to W^O, T; X) n L p { 0, T; D{A)) and 

ju'{t) = Au(t) + f(t) a.e. in [0, T], 

(u(0) = x. 

(ii) u is a strong solution of problem (3.1) in L p (0,T- X) if there exists a 
sequence {uk} in W 1,p ( 0,T;X) n L p (0,T; D(A)) such that 

u k -> u, and v! k - Au k -> / in L p (0, T;X), 

Uk( 0) —> x in X, as k —> oo. 

(iii) u is a classical solution of problem (3.1) in L p (0,T; X) if for all £ > 0 
uG W 1 ' p {£,T-,X)^L p (e,T- 1 D{A)) nC([0,T];I) and 

j u'(t) = Au(t) + f (t) a.e. in [0, T], 

(u(0) = x. 

(iv) The function 

u(t) = S(t)x + f S(t — s)f(s)ds 

J o 

is called the mild solution of problem (3.1) if u belongs to C([0,T];X). 

(v) u is a weak solution of problem (3.1) if u belongs to L p (0,T-, X), for 
all k in D(A*), (k,u(-))x belongs to W 1,p (0, T), and for almost all t in [0,T] 
and k in D(A*) 

I ^ k ' = ^ A * k ’ + 

\u(0) = x, 


where A* : D{A*) —» X' is the dual operator of A. □ 

Remark 3.1. The notion of weak solution for arbitrary Banach spaces was 
introduced by J. Ball [1] with the difference that he requires that u belongs 
to C([0, T];X) rather than L p { 0, T; X). □ 

When X is a reflexive Banach space, strong solutions can be characterized 
in a slightly different way. Recall that for a reflexive Banach space, the family 
of adjoint transformations {S*(t) € C(X'): t > 0} is a strongly continuous 
semigroup on X 1 and that the domain D{A*) of its infinitesimal generator 
A* is dense in X' . The injection D(A*) C X' is continuous and dense when 
D(A*) is endowed with the graph norm topology defined by the norm 

M d(a*) = Mat* + \A*x\ X '- 

As a result the injection X = X" C D{A*)’ is also continuous and dense since 
the elements of the bidual X" of X can be identified with those of X. 
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Remark 3.2. When X is a reflexive Banach space A* is the generator of the 
adjoint semigroup S*[t) and the notion of weak solution is equivalent to the 
existence of a function u in W 1,p (0,T; D(A*)') H L p (0,T; X) such that 

IV = (A*)*u + f in L p (0,T-D{A*)'), 

(u(0) = x in X. 

This is the usual setup for parabolic equations in the variational framework, 
where the operator — A arises from a variational problem. □ 

3.2 Existence and uniqueness of a strong solution 

Proposition 3.1. Assume that x G X and f G L p (0,T; X). Then problem 
(3.1) has a unique strong solution u in L p (0,T; X). Moreover u belongs to 
C'([0,T];X) and is given by the formula 

u(t) = S(t)x + f S(t — s)f(s) ds. (3-5) 

Jo 

Finally if u n is the solution of problem (3.2), then 

u n —> u in L p (0,T ; X) as n —> oo. 

Proof. Let u be the function defined by (3.5). Clearly u is continuous. To 
check that u is a strong solution of (3.1), set 

u k {t) = kR{k,A)u(t), f k {t) = k,R(k,A)f(t), x k = kR{k 1 A)x. 

By (3.5) it follows that 

u k (t) = S(t)x k + f S(t- s)fk(s) ds; 

Jo 

by differentiating with respect to t we see that u k is a strict solution of the 
problem 

f u' k (t ) = Au k (t) + f k {t), 

|it fe (0) = x k . 

By (2.28) in Theorem 2.5 it follows that u k —> tt, f k —> f in L p (0,T; X) and 
x k —■> x in X. Thus u is a strong solution. 

We now prove uniqueness. Let u be a strong solution of (3.1) and let {u k } 
be a sequence such that (3.4) holds. We set f k = u' k — Au k and x k = u k { 0). 
By integrating the equation 

-^(S'(t - s)u k (s)) = S(t - s)/ fc (s), s G [0,t] 

between 0 and t and letting k go to infinity, we find that u is given by (3.5). 
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As for the last statements we have 


i(t) - u n (t)\ < \S(t)x - e tAn x\ + [ I S(t- s)f(s) - s)An f(s)\ 

Jo 


ds 


and the conclusion follows from Theorem 2.5. 


□ 


Remark 3.3. In the literature a strong solution is generally called a mild so¬ 
lution. We shall also use this terminology in Parts IV and V. □ 

Proposition 3.2. Given x £ X and f € L p (0,T\ X), 1 < p < oo, problem 
(3.1) has a unique weak solution u that coincides with the strong solution given 
by (3.5). 

Existence. 

Let u be given by (3.5). By definition u £ C([0, T]; X) C L p (0,T;A). Given 
k in D(A*) and <j> in D(]0, T[), the vectorial distributional derivative of u is 
given by 

i-T r T r / rt \- 

I dt 


~[ {k,u(t)) D ( A .)<j>'(t)dt = - [ /k,S(t)k+ f S(t — s)f(s) ds 

Jo Jo L \ Jo 

= — f (k,S(t)k)<//(t) dt 
Jo 


ds f dt{k, S(t — s)f(s))cj)'(t). 
J s 


Now for all x in D(A) and k in D(A*) 


—(k,S(t)x ) = (. k,AS(t)x) x = ( A*k,S(t)x) x 

and by density of D(A) in X, this extends to all x in X. In view of this 
technical result, we can now integrate by parts in the previous equations 

— f (k, S{t)k)(j> (t) dt = — f (A*k, S(t)x)<j>(t) dt 
Jo Jo 

and 

-f (k,S(t-s)f(s))(j> , (t)dt = f (A*k,S(t-s)f(s)}4>(t)dt + (kJ(s))(l)(s). 

J s J s 

So finally 

- [ {k,u(t)} D ^ A »' ) <t> l (t)dt= [ (A*k, u(t)) + {k, f(t)}]<j)(t) dt. 

Jo Jo 

As u G (7([0, T]; X) and / e L p (0,T;X), (k,u(-)) belongs to W 1 ’^, T) and 
for each t in [0, T] 

J(k,u{t.)) = (. A*k,u(t )) + ( k,f(t )). 

So u is a weak solution of problem (3.1). 
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Uniqueness. 

It is sufficient to prove that u = 0 when x = 0 and / = 0. By definition of a 
weak solution for all k in D(A*) and t in [0,T] 

J '- t (k, u (t )) = (. A*k,u(t )} 


lim(fc, u(t)) = 0. 
t\,o 


Therefore 

( k,u(t )} = (\A*k, J u(s) ds^ = ( A*k,z(t )), 

where 

z(t) = / u(s)ds. 

J o 

We need the following lemma. 

Lemma 3.1 (Cf. S. Goldberg [1, p. 127]). Assume that A is a closed linear 
densely defined operator on X. Let u and z in X satisfy 

(k, u) = (A*k, z), Vfc G D{A*). 


where 


Then z £ D(A) and u = Az. 

In view of the lemma for each t, z(t) £ D(A) and u(t) = Az(t). Moreover 
since u £ L p (0,T;X), 2 £ L p {0, T; D(A)) and 

dz 

-(t) = u(t) = Az(t)£L p (0,T-,X). 

Therefore 0 £ L p (0, T; D(A)) n M /1 ’ p (0, T; X) and 

i d z 

~(t) = Az(t), t £ [0, T], 
z( 0) = 0. 


So z is a strict and hence a strong solution. By Proposition 3.1 this solution 
is unique and equal to zero. The uniqueness now follows from the fact that 
u(t) = Az(t) = 0 for all t in [0,T]. 

Remark 3.4. The key points of the above proof have been borrowed from 
J. Ball [1]. We see that for initial conditions x in X and right-hand-sides / in 
L p (0,T-, X) the two definitions of weak solutions coincide. In fact J. Ball [1] 
proved the following theorem for a closed linear densely defined operator A 
on X: For each x £ X, there exists a unique weak solution u(t) of (3.1) 
(u £ C(0,T];X)) satisfying u( 0) = x if and only if A is the generator of a 
strongly continuous semigroup {S(t)} on X. □ 
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Remark 3.5. The last two propositions show the equivalence of a solution in 
L p (0,T-, X) and a strong solution that is the limit in C([0, T]; X) of strict 
solutions. For reflexive Banach spaces the application 

u —> (u' — {A*)*u, u( 0)) 

: W 1 ’ p (0,T-D(A*)')nC([0,T]-X) -> L p (0, T; D{A*)') x X 
is injective and invertible on the subspace 

I/(0,T;I)xI of L P (0,T-,D(A*)') x X. 

So it is not an isomorphism, but its image is at least dense. □ 


3.3 Existence of a strict solution 

In order to obtain a strict solution of problem (3.1), we need more regularity 
in x and /. 

Proposition 3.3. (i) If x £ D(A) and f £ L p (0,T; D(A)) then prob¬ 

lem (3.1) has a unique strict solution that belongs to W 1,p ( 0,T;X) n 
C([0,T]-,D(A)). 

(ii) If x £ D(A) and f £ W 1,p (0,T; X), then problem (3.1) has a unique 
strict solution that belongs to C 1 ([0, T]; X) (~l C([0, T]; D(A)). 

Proof (i) Let u be the strong solution of problem (3.1) and let the solution u n 
of (3.2) be its associated approximating sequence. By hypotheses the problem 

(v'{t) = Av{t) + Af{t), 

|^u(0) = Ax 

has a strong solution v £ C([0,T];X). Let v n be the solution of the problem 
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So u n —* u in W l ' p (0,T; X) and v! = Au + /. 

(ii) Due to the hypotheses the problem 

I z'(t) = Az{t) + 

|^(0) = Ax + / (0) 

has a strong solution z G C([0, T];X). Moreover let z n be the solution of the 
problem 

(z’ n (t) = A n z n {t) + 

\z„(0) = A n x + /(0). 

Clearly z n = u' n so that, by Proposition 3.1, 

u n -> u, u' n = z n ->z in C([0, T]; X). 

It follows that u € C 1 ([0,T];X) and v! = z. Moreover Au = u' — f belongs 
to C{[0,T]-X) so that u G C([0,T]-,D(A)). □ 

3.4 Perturbations of infinitesimal generators 

Consider the problem 

ju'(t)=Au(t) + F(t)u(t) + f(t), t G [0, T], 

\«(0) = x (38> 

under the following hypotheses: 

(i) A is the infinitesimal generator of a strongly continuous 
semigroup S, and 

(ii) F is a mapping from [0, T] into £(X) (3.9) 

which is strongly continuous, that is F(-)x belongs to 

C([0, T];X) for any x G X. 

Set S n (t) = exp(fA„). By Theorem 2.5 there exist M > 1 and to G K such 
that 

\\S(t)\\<Me u \ \\S n {t)\\<Me“\ t > 0. (3.10) 

Moreover, by the uniform boundedness theorem , there exists K > 0 such that 

\\F(t)\\<K, t G [0, T], (3.11) 

If / belongs to L p (0,T; X), p> 1, then the function Ff, (Ff)(t) = F(t)f(t), 
is Bbchner measurable, as easily checked, and belongs to L p (0,T; X), whereas 
if / is continuous then Ff is continuous. 

The definitions of strict, strong, classical, and weak solutions in Definition 
3.1 can be extended in an obvious way to problem (3.8). We say, in addition, 
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that u is a mild solution of problem (3.8) if u is continuous in [0, T] and verifies 
the integral equation 

u(t) = S(t)x + f S(t — s){F(s)u(s) + f(s)} ds. (3-12) 

Jo 

Lemma 3.2. The following statements are equivalent: 

(i) u is a strong solution of problem (3.8) in L p (0,T;X). 

(ii) u is a mild solution of problem (3.8). 

Proof, (i) =>• (ii). Let u be a strong solution, then there exists a sequence 
{u k } C W 1 ’ p {0,T;X)nL p (0,T-,D(A)) such that 

u k -> u, u' k - Au k - Fu k = f k —> f in L p (0,T\ X), 

Uk( 0) —> x in X. 

Then u k is a strict solution of problem (3.1) with x = x k and / = f k + Fu k \ 
by Proposition 3.1 it follows that 

u k (t) = S(t)xk + [ S(t- s){F(s)u k (s) + fk(s)}ds 
Jo 

and, as k —> oo, we find that u verifies (3.12). 

(ii) =$■ (i). Let u € C([0, T\\ X) be a mild solution. Then, again by Propo¬ 
sition 3.1, u is the strong solution of problem (3.1) with / replaced by f + Fu. 
Thus, there exists a sequence 

{ Ufc } C 0, T; X) n L p { 0, T; D(A)) 

such that 


Uk —> u, u' k — Au k - Fu k —> / + Fu, in L p (0, T ; X), 
u k ( 0) —» x in X. 

It follows that 

u' k - Au k - Fu k -> / 

so that u is a strong solution of (3.8). □ 

We now solve problem (3.12). For this it is useful to introduce the approx¬ 
imate equation 

U n (t) = S n (t)x+ [ S n (t- s){F(s)u n (s) + f(s)}ds, 

Jo 

which is clearly equivalent to the system 

u' n {t) = A n u n (t ) + F(t)u n (t) + f(t), t G [0, T\, 
u n ( 0) = x. 


(3.13) 


(3.14) 
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Proposition 3.4. Assume that F verifies (3.9), x £ X and f G L p (f),T\X). 
Then the following results are true: 

(i) Problem (3.8) has a unique solution u in L p (0,T; X) that belongs to 
C([0, T];X). Moreover for each n, problem (3.14) has a unique solution 
u n € C([0, T];X) and u n —> u in C([0, T]\ X). 

(ii) If X is a reflexive Banach space, problem (3.8) has a unique weak solu¬ 
tion in W 1,p (0, T; D(A*)') H C([0, T]; X) which coincides with the strong 
solution in L p (0,T; X). 

Proof, (i) Problems (3.8) and (3.14) are respectively equivalent to the equa¬ 
tions 

u = w(u), u n = w n (u n ), (3.15) 

where the mappings w and w n are defined as 

= S(t)x + ( S(t — s){F(s)u(s) + f(s)} ds, 

Jo 

W n (u)(t) = S n (t)x + [ S n (t - s){F(s)u(s) + f(s)} ds. 

Jo 

Now w and w n map C[0,T]; X) into itself and, if k £ N, 

I W k (u) - W k {u)\ C ([o,T]-X) < T ) n \u - m|c([0,T];A') ; 

\w k {u) - w k {u)\ C ([o,T]-x) < ^ ( MKe w+T ) n \u - u\ C ( [ 0 ,t]-,x), 

where ai + = sup{w,0}. Now the conclusion follows by the Contraction Map¬ 
ping Principle. 

(ii) Existence. We know from part (i) that (3.12) has a unique solution u 
in C([0, T]\X). We show that u belongs to W 1,p (0,T; D{A*)') and that 

u' = [(A*)* + F{t)]u + f in L p { 0, T; D(A*)'). 


We compute the vectorial distributional derivative of u: for k in D(A*) and 
<t>€V(]0,T[) 

— J (k,u(t))<f> (t) dt =— J (\k,S(t)x+J S(t—s)[F(s)u(s)+f(s)]ds^(j)(t)dt 

= — f (S*(t)k,x)<j/(t) dt 
Jo 

— f dt f ds(S*(t—s)k,F(s)u(s)+f(s))(j>'(t) 

Jo Jo 

= j Q 
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So finally 


+J ^ L ds (^^ S *^ ~ S ^ k,F ^ U ^ + ^ S ^)^ 

= f (S*(t)A*k, x)(f>{t) dt 
Jo 

+ f dt f ds(S*(t — s)A*k,F(s)u(s) + f(s))(f>(t) 

Jo Js 


(k , F(s)u(s) + f{s))<j>(s) ds 


/ o 

rT / 


=J (k,(A*y S(t)x+J 0 


S(t)x+ / S(t—s)[F(s)u(s) + f(s)]ds 


+ F(t)u(t) + f(t)j(t>(t)dt 


v! = (A*)*u(t) + F(t)u(t) + f(t) G L p (0,T; D{A*)') (3.16) 

and u G W^’P^T]; D{A*)') n C([0,T];X). 

Uniqueness. 

The proof is similar to the one of Proposition 3.2. It is sufficient to prove that 
for x = 0 and / = 0, (3.16) has only the solution u = 0. So first note that 
u = 0 is a solution of (*) with u(0) = 0 in W /1,p (0, T; D(A*)') fl C([0, T\; X). 
We fix T > 0 and k in D(A* ) and introduce the function v(T, t) = S*(T — t)k. 
Then 

^(v{T,t),u(t)) x = (v(T,t),F(t)u(t)) x 

and 

(v(T, T),u(T)) x = (v(T, 0), u(0)> + [ (v(T, t),F(t)u(t)) dt. 

J o 

So for all k in D(A*) 

(k,u(T))x = f (k, S(T — t)F(t)u(t)) dt 
Jo 

and necessarily 

u(T) = f S(T — t)F(t)u(t) dt. 

Jo 

But this means that u is a mild solution for x = 0 and / = 0. So u and 0 are 
mild solutions. However since the mild solution is unique u(T) = 0, VT > 0. 
This completes the proof. □ 

We now study strict solutions. The proof of the following proposition is 
the same as the one of Proposition 3.3 and will be left to the reader. 
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Proposition 3.5. The following statements hold: 

(i) Assume that F verifies (3.9) and that Ffi)x £ C([0, T]; D(A)) for any 
x £ D(A). If, in addition, x £ D(A) and f £ L p (0,T\ D(A)), then 
problem (3.8) has a unique strict solution 

u£ W 1 ’ p (0,T;X)nC([0,T)-,D(A)). 

(ii) Assume that F verifies (3.9) and that Ffi)x £ C 1 ([0,T];X) for any 
x £ X. If, in addition, x £ D(A) and f £ W llP {f),T\ X), then problem 
(3.8) has a unique strict solution 

u£C 1 ([0,T]-X)nC([0,T}-D(A)). 


3.5 Evolution operators 

Consider the systems 

f u'(t) = Au(t ) + F(t)u(t) + f(t ), t £ [s, T], 
|u(s) = a;, sG[0,T], 

iu' n {t) = A n u n (t ) + F(t)u n (t) + f(t), t £ [s, T\, 
1u n (s)=x, s £ [0, T\. 


(3.17) 

(3.18) 


The generalization of Propositions 3.4 and 3.5 to these systems is straight¬ 
forward. Then, by Proposition 3.4 we know that system (3.17) (resp. (3.18)) 
has a unique strong solution. We define the transformations U and U n of X 
as follows: 


U(t, s)x = u(t), U n {t, s)x = u n (t), t > 0, x £ X. 

As easily seen U(t,s ) and U n fit,s) are linear bounded operators in X. The 
mapping U 

fit, s)^Ufit, s ): A t -> CfiX), 

where 

A t = {( t,s ): s £ [0 ,T],t £ [s,T]}, 
is called the evolution operator associated with A + F. 

Proposition 3.6. Assume that A is the infinitesimal generator of a strongly 
continuous semigroup on X and that F verifies (3.9). Let U be the evolution 
operator relative to A + F and U n the evolution operator relative to A n + F. 
Then the following statements are true: 

(i) Ufi)x is continuous in At for any x £ X. 

(ii) For any x £ X, linin^oo U n fit, s)x = Ufit, s)x uniformly in (t, s) £ At- 

(iii) IfT>t>s>r> 0, then U(t,s)U(s,r) = Ufit, r), U ( s, s) = I. 
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(iv) For any (t,x) € At, we have 

||J7(t,s)| < \\U n {t,s)\\<Me^ +K ^- s \ (3.19) 

where K = sup{||F(f)||: 0 < t < T}. 

(v) If f € L p (0,T; X) the strong solution of (3.8) is given by 

u(t) = U(t,0)x + f U(t,s)f(s)ds. (3.20) 

Jo 

Proof. Let w s and w sn be the mappings in C([s,T]; X) defined by 
w s (u)(t) = S(t — s)x + f S(t — r)F(r)u(r ) dr, 

J S 

w sn {u)(t) = S n (t - s)x + f S n (t — r)F(r)u(r) dr. 

J S 

If k £ N we have 

|ioJ(u)-ioJ(u)| c .( [S)T] ; X ) < ^(MKe u+T ) n \u - u\ c{[ ^ T] . X ), 

\ w sn( u ) - ’ u ’sn(' S )lc([ S ,T];.Y) < ^y(Mii'e“ T )"|« - u|c([a,T];X), 

where u> + = sup{w,0}. Thus the statements (i) and (ii) follow by the Con¬ 
traction Mapping Principle. Moreover (iii) and (v) follow from (ii) (since the 
analogous statements for U„ are well known). Finally (iv) is a consequence of 
the Gronwall lemma. □ 


3.6 Maximal regularity results in Hilbert spaces and main 
isomorphism 

We go back to the problem 


u'{t) = Au(t) + f(t), t € [0,T], 
u(0) = x. 


(3.21) 


By Maximal Regularity we mean that u! and Au have the same regularity as 
/. We assume that 

(i) H = X is a Hilbert space and that 

(ii) A is the infinitesimal generator of an analytic semigroup (3.22) 
of negative type. 

The hypothesis that the type of S be negative is not restrictive since by 
the transformation v = e 8t u we can change A to A — 81 (cf. Theorem 2.11). 
Therefore since S is an analytic semigroup of negative type, there exists M > 0 
such that 

M 

P(A,A)|| < —, if Re A >0. (3.23) 

|A| 
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Remark 3.6. We shall see in §3.7 that maximal regularity can also be studied 
in a general Banach space. □ 


In the first part of this section we study problem (3.21) with u(0) = 0, 
that is 

[u'{t) = Au(t) + f{t), t £ [0, T], 

\ti(0) = 0. 1 ‘ J 

In the second part we will consider the problem (3.21) with it(0) = x and we 
shall give conditions on x and / such that maximal regularity holds. This will 
naturally lead us to interpolation spaces, which will be studied in detail in §4 
and the construction of the main isomorphism. 

Assume that / € L 2 (0, T; H), then by Proposition 3.1, problem (3.24) has 
a unique strong solution given by 

u(t) = f S(t — s)f(s) ds. (3.25) 

Jo 

In order to study the regularity of u it is convenient to use the Fourier trans¬ 
form in H. 

For any u £ T>( R, H) we set 


u(k) 


r+oo 


e lkt u(t) dt. 


(3.26) 


Let {e a } a £r be a complete orthonormal system in H. By Parseval’s equality 
applied to the scalar function (u(t), e a ), we have 


i /--t-oo r-\-oo 

— / \(u(k), e a )| 2 dk = / \(u{t),e a )\ 2 dt, (3.27) 

which implies that 

i r+oo !•+ oo 

— / \u(k)\ 2 dk = / \u(t)\ 2 dt. (3.28) 

2tt 7_oo 7-oo 


Then the mapping 


u i—^ 7 (u) = u: V(R, H) L 2 (K; H) 

is continuous with respect to the L 2 (R, 77)-topology and can be uniquely 
extended to all L 2 (R, H). We shall denote by j(u) or u such an extension. 


3.6.1 A priori estimates for An 

We first assume that / £ T>(] 0, oo[; H) and consider the problem 
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u'(t) = Au(t ) + f(t), teR, 

u{0) = 0 , 


(3.29) 


where 


m = 


m if i € ]0,T[, 


0 iff£]0,T[. 

Due to Proposition 3.1, problem (3.29) has a unique strong solution given by 


u(t ), 
u{t) = { 0, 


iff G [0,T], 
if t < 0 , 

e (T-t)A u ( T ) ) if t > T} 


(3.30) 


where u is the strong solution of problem (3.24). Since S is of negative type, 
we have 

u, Au , v! GL 2 {R-H). (3.31) 

Lemma 3.3. We have for all f in W 1,2 (0, oo; H) and T > 0 

[ T \Au{t)\ 2 dt < (M + l ) 2 [ T |/(t )| 2 dt. (3.32) 

Jo Jo 


Proof. By (3.29) it follows that 


r+oo /-+oo 

e~ ikt u dt = / -~ ikt 


r+oo 

e ~ lkt Au(t) dt + / e ikt f dt. 
Jo 


Denote by u and / the Fourier transforms of u and /, respectively. Then 

iku(k) = Au{k) + f(k), 

so that 

u(k) = R(ik, A)f(k), 

which implies that 

\Au(k)\<(M+l)\f(k)U 

and by Parseval’s inequality, we obtain (3.32). □ 


3.6.2 Main result for the case u(0) = 0 

As S' is a semigroup of negative type, \Ax\ is a norm on D(A) equivalent to 
the graph norm and A is an isomorphism for D(A) onto H. As a result 

IMli 2 (0,oo;ff) = \\Au\\l2(0,oo-,H) + II u '\\l 2 (0,oo;H) 
is a norm on the space 

W(2,0-,D(A),H) = W 1,2 (0, oo; H) n L 2 (0, oo; D(A)). (3.33) 

Such spaces will be studied in more detail in §4. 

In view of the previous a priori estimates, we have the following result. 
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Proposition 3.7. Assume that (3.22) holds and that f belongs to L 2 ( 0, oo; H): 

(i) Problem (3.24) has a unique strict solution u in W(2, 0; D(A), H) and 
the following inequality is verified: 

Mw < V2(M + 2 )||/|| ia(0iOO;J0 . (3.34) 

(ii) The linear map 
u i —> v! — Au 

:W 0 = {ve W( 2,0; D(A), H) : u(0) = 0} -> L 2 { 0, oo; H) (3.35) 
is an isomorphism. 

Proof, (i) Given / in L 2 (0, oo;H), we know that (3.24) has a unique strong 
solution in all intervals [0, T], T > 0, for which inequality (3.32) holds. In 
particular we can let T go to oo and 

\\Au\\ 

L 2 (0,oo;ff) < (M + l)||/|||2( 0)OO;JJ -). 

Moreover because u' = Au + / 

ll« , || 2 L 2 ( 0 ,oo; ff )<(^ + 2 )||/lli 2 ( 0 ,oo; ff ) 

and we get inequality (3.34). So u is a strict solution because 

u G W 1,2 (0, oo; H) D L 2 (0, oo; D(A)) . 

(ii) As the map u e-> u( 0): W / 1 , 2 (0, oo; H) —> H is linear and continuous, 
W 0 is a closed subspace of W. The map (3.35) is clearly linear and continuous. 
It is bijective from part (i) because for all / in L 2 (0, oo; H), (3.24) has a unique 
solution in Wq. Hence (3.35) is an isomorphism. □ 

3.6.3 The case u(0) = x and the main isomorphism 

We now consider the problem 

(u'(t) = Au(t,) +f(t), t G [0, T], ^ 3 36 ) 

1 u(0) = x. 

In order to complete the isomorphism (3.35) and stay in the space of solu¬ 
tions W(2,0-,D(A),H), it is necessary to introduce appropriate interpolation 
spaces, which will be studied in details in §4. 

Consider the following subspace: 

Da{\, 2) d = M0) : u G W{ 2, 0; 15(A), H)} (3.37) 


of H endowed with the quotient norm 
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||x||d = inf{||u||w: u G W(2,0;D(A),H) and u(0) = x}. (3.38) 

D A (l/2, 2) is the space of traces T( 2, 0; D(A), H ), that will be studied in §4.2. 
It will be shown in Proposition 4.3 that this space of traces is isomorphic to 
the space of averages ( D(A),H )\/ 2,2 as defined in (4.14). In the variational 
literature this space is also written [D{A), H]i/ 2 . It is readily seen that the 
map 

u h- u(0): W (2,0; D(A), H) - D A (§, 2) 
is linear continuous and onto. 

Theorem 3.1. The following statements hold: 

(i) Assume that (3.22) holds; then the map 

u i—> (y! — Au , w(0)): W{2, 0; D{A), H) -> L 2 (0, oo; H) x D A (§, 2) (3.39) 

is an isomorphism. In particular for all f in L 2 ( 0, oo; H ) and x in D A (l/2, 2), 
problem (3.36) has a unique strict solution in L 2 (0, oo;H). 

(ii) Assume that S is an analytic semigroup in the sense of Definition 2.3 
in §2.7. Then for each T > 0, the map 

u e-> ( u — Au, ■u(O)) 

: W 1 ’ 2 {Q,T-,H)nL 2 (Q,T-,D{A)) -► L 2 (0,T;H) x D A (\,2) (3.40) 

is an isomorphism. In particular for all f in L 2 (0,T; H) and x in D A { 1/2, 2), 
problem (3.36) has a unique strict solution in L 2 (0,T; H). 

Proof, (i) The map (3.39) is clearly linear and continuous by construction. 
We show that it is surjective and hence an isomorphism by the Open Map¬ 
ping Theorem (cf. K. Yosida [2, §5, pp.77]). This is equivalent to prove 
that for each (/, x) in L 2 (0,oo; H) x D A ( 1/2,2), there exists a unique so¬ 
lution in W(2, 0; D(A), H) to problem (3.36). So for each x in D A ( 1/2,2), 
there exists u\ in W(2,0; D(A), H) such that ui( 0) = x and u[ — ^4zti G 
L 2 (0,oo: H). For each f in L 2 (0,oo; H), there exists a unique strict solution 
u 2 in W(2,0;D(A),H) to 

u' 2 — Au 2 = f — (u'i — Au\), u 2 (0) = 0 

by Proposition 3.7. The sum u = Ui+u 2 belongs to W{ 2, 0; D(A),H), u( 0) = x 
and 

vl = u[ + u' 2 = u[ + Au 2 + / — {u\ — Au\) = A(u\ + u 2 ) + f = Au + f. 

We have constructed a solution u in W(2,0;D(A),H) to problem (3.36). 
Therefore the map (3.39) is surjective. It is injective if for / = 0 and x = 0 
the only solution u in W(2, 0; D(A),H ) is u = 0. But this is true by Proposi¬ 
tion 3.7 (ii). 
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(ii) The term u i—> v! — Au is well-defined linear and continuous. We only 
have to check that for u in IT 1 , 2 (0, oo; H)nL 2 ( 0, oo; D(A)), u( 0) G Da{ 1/2, 2) 
or equivalently that there exists u in IT 1 , 2 (0, oo; H) D £ 2 (0, oo; D(A)), such 
that u(0) = u. It turns out that 


~,.s Vt 

u(t) = -—— u 


1 + t V 1 T t 


tT 


is such a function since 


ll^lli 2 (0,oo;tt) — ll^ M lli 2 (0,T;it) 


and moreover 


u'{t) 

\u'(t)\ 


tVT 


< T 


(1 + t ) 3 

VT 


1 + t 


tT \ 

1 + t J 
tT \ 
1 +1 ) 


VT 
(i + t ) 2 
VT 


i + i Vl +1 


tT 
1 + t 
tT 


So v! G L 2 (0, oo; H) since each of two terms on the right-hand side does. 

Now first assume that S' is a semigroup of negative type. The map (3.40) 
is bijective since for all x G 15,4(1/2,2) and / G L 2 (0,oo\ H) there exists a 
unique solution ut in II rl, 2 (0, oo; H) n L 2 (0, oo; D(A)) to the eciuation 

u T - Au t = fr, u T ( 0 ) = x, 


where fx in L 2 (0, oo; H) is given by 


frit) 


fit) if 0 <t<T, 

0 if t > T. 


Its restriction u to [0, T] belongs to IT 1 , 2 (0, T; H) n T 2 (0, T; D{A)) and 

u' = Au + /, u(0) = x. 

The existence implies the surjectivity and the uniqueness the injectivity. 

When S(t) is not of negative type, uo = <x>o(S) > 0, fix lo > u>q and define 
S u (t) = S(t)e _ ^ a,+1 ^. Then wo(S w ) < —1 and A u = A — (w + 1)1. Consider 
for / in L 2 i0,T;H) and x in £>^(1/2,2) the problem 

V - Au w = f u , u^i 0) = x, 

where 

f u (t)=e~(“ +1)t f(t), 0 <t<T. 

Since S w is of negative type we are back to the previous situation and we 
know that there exists a unique solution u u in IT 1,2 (0, T; H) n £ 2 (0, T; D{A)) 
since D(A U ) = D{A). Define 
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u(t) = 0 < t < T. 

Then u belongs to W 1 , 2 (0, T; H) fl L 2 (0, T; D(A)) , and it is readily seen that 

u = Au + /, u( 0) = x. 

So again we have a bijection and an isomorphism. □ 

Corollary 3.1. When S is an analytic semigroup in the sense of Defini¬ 
tion 2.3 in §2.7, then for all T > 0 

MO): u G W 1 ’ 2 ^, T; H) D L 2 ( 0, T; D{A)) } = D A (|, 2) . 

Concerning classical solutions, we have the following results. 

Proposition 3.8. Assume that f G L 2 (0,T;H) and x G H; then problem 

(3.36) has a unique classical solution in L 2 (0,T; H). 

Proof. Let u be the strong solution of (3.36). Set 

u(t) = S(t)x + v(t). 

Then, due to Theorem 3.1, v is the strict solution of the problem 

= Av(t) +f(t)$ t> 0, 

ju(0) = 0. 

As S(t)x is analytic for t > 0, it follows that u is a classical solution of problem 

(3.36) . 

To show uniqueness, it is sufficient to show that 0 is the unique classical 
solution of the problem 


z'(t) = Az(t), 
z(0) = 0, t > 0. 


(3.41) 


Let z be a classical solution of (3.41); then z verifies (3.41) for any t > 0. We 
have 

- j~(S(t — s)z(s)) = 0 for all 0 < s < t. 

By integrating this between e and t — e, we obtain 


S(e)z(t — s) = S(t — e)z(e). 


As z is continuous, letting e tend to 0 we find z = 0. □ 

More information on problem (3.36) will be given in §4. 
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3.7 Regularity results in C([0, T]; X) 


Let X be a Banach space and let A: D(A ) C X —> X be the generator of an 
analytic semigroup S. Let M > 0, N > 0, and u € K be such that 


[||S(i)|| < Me"*, ||(A-u,J)S(i)||<^e"*, t> 0, 

1 N 

|j|S„(t)|| <Me"*, \\(A n -coI)S n (t)\\< T e^, t > 0. 


(3.42) 


We consider here the problem 


[ u'{t) = Au(t) + f(t), 
l^w(O) = x £ X, 

where / belongs to C([0,T]; A). We know that the mild solution of (3.43) is 
given by 

u(t) = S(t)x+ f S(t — s)f(s) ds. (3.44) 

Jo 

The following results are well known (see, for instance, A. Pazy [1]). 

Proposition 3.9. Assume that f £ C a ([0,T]-,X), a £ ]0, 1[, and x £ D(A). 
Then problem (3.43) has a unique strict solution 

u£C\[0,T};X)nC([0,T}-D(A)). 


Moreover 

u'{t) = S(t)(Ax + f(t)) + f AS(t-s)(f(s)~ f(t))ds. (3.45) 

Jo 

Proof. By making the change of variable v(t) = u(t)e ~ ut , t > 0, it is sufficient 
to prove the theorem for a semigroup S(t) such that ui = 0. We first note that 
formula (3.44) is meaningful because, by (3.42), we have 

| AS(t-s)(f(s) - f{t)) | < N\\f\\ ca{[0 ' T] . x) \t- s|“ -1 . 


Now set 


u n (t) = S n (t)x + [ S n (t 
Jo 


Then it is easy to check that 


s) ds. 


u' n {t) = S n (t)(A n x + f(t)) + [ A n S n (t — s)(/(s) — f(t)) ds. 

Jo 

As x £ D(A) and | A n S n (t - s)(f{s) - /(f)) | < A'||/||c«([o ) r] ; x)|f - we 

have, by the Dominated Convergence theorem, 
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lim u' n (t) = S(t)(Ax + f{t)) + [ AS(t - s)(/(s) - f(t)r) ds 

n >oo J q 

uniformly in t G [0 ,T\. It follows that u G C 1 ([0,T];A) and (3.45) holds. 
It remains to prove that u G C([0, T]\ D(A)). We have in fact A n u n {t) = 
u' n (t) — fit) so that AinR(n, A)u n {t)) —> u'ft ) — f{t) as n —> oo uniformly 
in t G [0,T]. As A is closed and nl?(n, A)u„(f) —» u in (7([0,T]; X), it follows 
that u G C([0, T]; H(A)) and v! — Au = f. □ 

Proposition 3.10. If f G C([0,T]; X) and x = 0 ; we have u G C a i[0,T}-, X) 
for any a G ]0,1[. 

Proof. Let t > s > 0; then by (3.44), we have 

ft /•* ft~r 

uit) — tt(s) = / Sit — r)/(r) dr + / dr S 1 (cr)/(r) da. 

Js J 0 J s—r 

By (3.42) it follows that 

I ^t) - uis )| < A/e |w|T ||/|| C ([o.T];A')|i - s| + A r ie l “ |T ||/|| C ([o.T];A), 


where 


L = 



, /■‘- r da 

dr — < 

J s—r tr 



r)~ a 



da 


1 

< - 


a 



r)~ a dr\t-s\ a < 


T 1-a {t- s) a 
1 — a a 


Thus, the conclusion follows. □ 

Consider now the special case / = 0. We have the following results. 

Proposition 3.11. Set uit ) = Sit)x, and let a G ]0,1[ ,T > 0. Then the 
following statements are equivalent: 

ii)uGC a i[0,T]-X), 

(ii) suptgjo^] t~ a \Sit)x — a;| < oo. 

Proof, (i) => (ii) follows from 

t~ a \S(t)x-x\ < |M|c»([ 0 ,T];A-)- 

(ii) => (i). If t > s > 0, we have 

Sit)x — Sis)x = /S'(s)(S'(t — s)x — a;) 

so that there exists a constant C > 0 such that 


\S(t)x — S'(s)a:| < C\t — s| a . 


□ 
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We set 


\x\ a = sup {t a \S(t)x — x\: a £ ]0,1[}, (3.46) 

te]o,T] 

Da(cx, oo) = {x G X: \x\ a < oo}. (3.47) 

Da (a, oo) is an interpolation space (see §4). 

The following maximal regularity result was proved by E. Sinestrari [1] 
(see also G. Da Prato and P. Grisvard [1]). 

Theorem 3.2. Assume that f £ C a ([0,T]- X), a £ ]0,1[, x £ D(A). Letu he 
the solution of (3.43). Then the following statements are equivalent: 

(i) Ax + /(0) £ D A (a, oo), 

(ii) v!, Au belongs to C“([0, T]; X). Moreover, if (i) or (ii) holds, we have 
u'(t) £ Da {ex, oo) and 

sup \u'(t)\ a < 00 . 
te]o,T] 

We complete this section with a simple analyticity result. 

Proposition 3.12. Let f £ C([0,oo[;X) and x £ X. Assume that f has an 
analytic extension in a sector So = {A £ C: | argA| < 9} for some 9 > 0. Let 
9 0 £ ]0, 7t/2] such that the semigroup S is analytic in Sg 0 . Then if u is the 
solution of (3.43), u has an analytic extension in Sg A g 0 . 

Proof. Follows immediately from (3.44). □ 

3.8 Examples of nonhomogeneous problems 
3.8.1 Parabolic equations 

Let O be an open set of R with smooth boundary (9fh Consider the following 
initial value problem with Dirichlet boundary conditions: For all t > 0 

du, du ( d \ 

m {t ' x)= ^ * Gn ’ 

j, k - 1 (3.48) 

u(t, x) = 0, x £ dfl, 

u(0, x) = uq(x), tell, 

where ajk are real continuously differentiable functions in Q and verify the 
ellipticity condition (2.89). 

Let H = L 2 (D) and let A be the linear operator defined by (2.94). As 
proved in §2.9, A is the infinitesimal generator of an analytic semigroup in 
H = L 2 (D). The interpolation space ^^(1/2,2) coincides with iLo(ff) (cf. 
J. L. Lions and E. Magenes [1]). 

By using Propositions 3.7 and 3.8, we find the following result. 
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Proposition 3.13. The following statements hold: 

(i) If f G L 2 ([0,T] x Cl) and uq G L 2 (Cl); then problem (3.48) has a unique 
classical solution u that belongs to 

C([0, T]; L 2 (Cl)) D W 1>2 (e, T; L 2 {Cl)) n L 2 (e, T; H 2 (Cl) n H%(Sl)), 

for any e G ]0, T[. 

(ii) If f G L 2 ([0,T] x Cl) and u o G Hq(CI), then the solution u is strict and 

u G W 1,2 (0, T ; L 2 (Ci)) n L 2 (0, T ; H 2 (Cl) D Hq(Q)) . 

For characterization of several interpolation spaces between the domain of 
an elliptic operator and L p (Cl) or C a (Cl), see respectively P. Grisvard [2] 
and P. Acquistapace and B. Terreni [2]. Similar results can be obtained 
for Neumann or more general boundary conditions. 


3.8.2 Schrodinger equation 

We shall use here the notation of §2.10. Consider the problem: For all t > 0 

+ f{t,x), x G Cl, 

(3.49) 

u(t, x) = 0, x G dCl , 
u(0, x) = uq(x), x G Cl. 

By using Propositions 3.1 and 3.3, we find the following results. 
Proposition 3.14. The following statements hold: 

(i) If f G L 2 ([0,T] x Cl) and uq G L 2 (Cl), the problem (3.49) has a unique 
strong solution 

uGC([0,T]-,L 2 (CI)). 

(ii) If f G L 2 (0,T; H 2 (Cl) (~l Hq(CI)) and uq G H 2 (Cl) fl Hq(CI), then the 
solution u is strict and 

uGW 1 ’ 2 (0,T-,L 2 (Cl))nC([0,T]-,H 2 {Cl)nH^{Cl)). 

(iii) If f G W 1,2 (0,T; L 2 (Cl)) and uq G H 2 (Cl) fl Hq(CI), then the solution u 
is strict and 



U G c 1 ([o, T\,L 2 (CI)) n c([o, T]-H 2 {CI) n Hl{Ci)). 
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3.8.3 Wave equation 

We use here the notation of §2.10 and consider the problem: For all t > 0 

g 2 n g / g \ 

» u(t ' *> = 2J j • * e 

«(t,a:)=0,ie911 1 ( 3 . 50 ) 

u(0,x) = u 0 (x), 

d 

—u(0,x) = ui(x), xe!l. 

We now prove the following result. 

Proposition 3.15. The following statements hold: 

(i) Assume that f £ L 2 ([0,T] x fl), uq £ Hq({ 2), and u\ £ L 2 (fl). Then 
problem (3.50) has a unique strong solution u that belongs to 

(ii) Assume that f £ L 2 (0,T;H 2 (fl) fl Hq(0)) ; uq £ H 2 (Q) n Hq (0), and 
u\ £ Hq(Q). Then u is a strict solution that belongs to 

C([0, T}-H 2 (Q) n ^(O)) n c 1 ([o, t]- h^h)) n w 2 ’ 2 (o, t- l 2 (o)). 

(iii) Assume that f £ W /1,2 (0, T; L 2 (fl)), uq £ H 2 (Q) fl Hq(Q), and u\ £ 
Ftg(O). Then u is a strict solution that belongs to 

C([0,T];// 2 (f2)n// 0 1 (0))nC 1 ([0,r];iy o 1 (f2))nC 2 ([0,r];L 2 (0)). 

Proof. Setting 



n 


u(t,-) 


r , 

U(t) = 

/(*,•)_ 

, m = 

d , V 

, Uo = 

Uo 

Ui_ 


problem (3.50) is equivalent to 

U' = AU + F(t), U(0) = U o , 


where the operator A is defined by (2.94). Now all conclusions follow from 
Propositions 3.1 and 3.3. □ 
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3.9 Point spectrum operators 

If L : D(L ) C X —> X is a linear operator, we set 


a ( L ) = {A € <t(L) : Re A < 0}, 

(3.51) 

cr + (L) = {A € cr(L ): Re A > 0}, 

(3.52) 

a°(L) = {Ae a(L): Re A = 0}. 

(3.53) 


The elements of a~(L ) are called the stable points and those of er + (L) the 
unstable points of the spectrum of L. 

In this section we are interested in solutions of the equation 

u'(t) = Au(t) + f(t) (3.54) 

either on all the real line or in [0, +oo[. Given 

/eL 2 (l;I) (resp. L 2 ([ 0 ,+oo[; X)), 

we say that u € L 2 (R;X) (resp. L 2 (0, +oo; X)) is a mild solution of (3.54) if 

u(t) = e^~ a)A u(a) + f e^- s)A f{s) ds (3.55) 

J a 

for all a and all t in R (resp. in [0, +oo[) such that a < t. We will study this 
problem under hypothesis (V) below. 

We say that a linear operator L : D(L) C X —> X in X verifies Assumption 
(V) if the following conditions are verified: 

Assumption (V). 

(i) L is the infinitesimal generator of a strongly continuous semigroup e tL 
on X, 

(ii) a°(L ) is empty and er + (L) consists of a finite set of eigenvalues of finite 
algebraic multiplicity, 

(iii) there exists e > 0 , Nl > 0 such that 

sup{ReA: A € a~(L)} < —e 

and 

|| e tL (I - n L )\\ < N L e~ et Vi > 0, (3.56) 

where IIl is the projector on the subspace of all eigenvectors correspond¬ 
ing to the eigenvalues in cr + (L) defined by 

n L = -L / R{ A, L) d\ (3.57) 

27TI J 1 

and 7 is a simple Jordan curve around a + (L) in the open half plane of 
all A such that Re A > 0. 
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We set 

x+ = n L x, XI = (i - n L )x. (3.58) 

Remark 3.7. Assume that L fulfills (V). Then by hypothesis (ii), X£ is finite 
dimensional and there exists rj > 0 such that 

ReA>?i, for all A € a + {L). (3.59) 

Moreover the subspace X£ is stable for the semigroup e tL , which can be 
extended for t < 0 by the formula 

e tL n L = I e tx R{ A, L) dX, t € R. (3.60) 

27TJ J 7 

Finally, by (3.59)-(3.60), it follows that there exists N' L > 0 such that 

\\e tL n L \\ < Vt < 0. (3.61) 

□ 


Remark 3.8. Assumption ( V ) holds in the following cases: 

(a) H has a finite dimension and a(A) fl *R = 0. 

(b) e tL is compact for any t > 0 and a(A) D *R = 0, 

where (a) is a special case of (b). □ 

We first study solutions of (3.54) on all the real line. 

Proposition 3.16. Assume that A verifies hypothesis ( V ). Then if f € 
L 2 (R, X), equation (3.54) has a unique mild solution u € L 2 (R;X) that is 
given by the formula 

/ t r+oo 

e (t- s M(j _ n A )f (s) ds — / e^ A n A f(s)ds. (3.62) 

-oo J t 

Proof. First of all, we notice that formula (3.62) is meaningful due to (3.56) 
and (3.61). 

Step 1 (Existence). Assume first that / € L 2 (R; D(A)) and let u be the func¬ 
tion defined by (3.62). Then we have 

u'(f) = (I - n A )f(t) + A f - n A )f{s) ds 

J — oo 

/ —oo 

e ( t ~ s ) A n A f(s) ds = Au(t) + f(t). 

Thus we have proved that if / € L 2 (JH; D(A)) , then u is a solution of (3.54). 
To prove the existence in general, it is sufficient to approximate f(t) by 
kR(k,A)f(t) and let k tend to infinity. 
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Step 2 (Uniqueness). It is sufficient to prove that if 
u G W 1 ’ 2 (R;X)<1L 2 (R;D(A)) 

is such that it'(f) = Au(t ) for all t G K, then u(t) = 0 for all t. In fact for 
such a u, we have u(t ) = e tA u( 0), so we must have IIau(0) = 0 and then 
IlAu(t) = 0 for all t. It follows that for all t > s 

u(t ) = e ( * _s)j4 (/ - n A )u{s), 


and, as t —> +oo, we find u(t) = 0 by (3.56). 

□ 

Now we consider solutions of (3.54) in [0,+oo[. 

Proposition 3.17. Assume that A verifies hypothesis ((P). Then if f G 
L 2 (0,+oo;X), the mild solutions of (3.54) in L 2 (0, +oo;X) are given by the 
formula 


u(t) = e tA (I — IIa)x + f S ^ A (I — IlA)f(s) ds 

Jo 

+oo 

e {t ~ s)A n A f(s)ds, iGl. (3.63) 

Proof. The fact the function in (3.63) defines a solution of (3.53) in 
L 2 (0,+oo;X) can be easily checked. Conversely, let u G L 2 ( 0,+oo;X) be 
a mild solution of (3.54) in L 2 (0, +oo;X). Then we have 



fit) = e tA u( 0) + f e^- a)A f{s)ds 

Jo 


= e tA (I - n A )u(0) 


ft f+oo 

+ / e (*“ s ) A (7 _ n A )f(s) ds — / e {t - s)A n A f{s)ds + v{t ), (3.64) 

JO Jt 


where 


(t) = e tA [ n A u(0) 



e~ sA n A f(s) ds 


(3.65) 


Now, v is bounded in L 2 (— oo, 0; X) and by (3.64), v in L 2 (0, +oo; X). Thus v 
is a bounded solution of (3.54) with /(f) = 0, and, by the uniqueness proved 
in Proposition 3.16, it follows that v(t) = 0 for all t. In conclusion u is given 
by (3.63) and the proof is complete. □ 


Corollary 3.2. Assume that A verifies Assumption ( V ). Let x G X, f G 
L 2 (0,+oo;X) and letu be the mild solution of problem (3.1) in L 2 (0, +oo;X). 
Then the following statements are equivalent: 

(i) / S I/ 2 (0, +oo; X); 
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(ii) the following compatibility condition holds 

r +oo 


r- l-oo 

IIax+ / e~ sA IlAf{s) ds = 0. 

Jo 


(3.66) 


Proof. The conclusion follows from (3.64)-(3.65) and Proposition 3.17. □ 


4 Interpolation spaces 

4.1 Notation 

We shall consider two Banach spaces Xq and X\ with Xq continuously and 
densely embedded in X\. Denote by | - |o and | • |i the respective norms of Xq 
and X\. Let k > 0 be a constant such that 

Mi < k\x\ 0 - (4.1) 

For any p > 1 and i = 0 or 1 we shall denote by Lf(Xj) the Banach space of 
all Bochner measurable mappings u: [0, +oo[ —> X\ such that 

J o l u (*)lx 4 y < +°°- ( 4 - 2 ) 

We shall use Hardy’s inequality, which we recall below. 

Lemma 4.1. Let u : [0, +oo[ —■> R be measurable and such that t a u £ L p { 0, oo) 
for some a € ]0,1[. Setting 

1 f* 

M(u)(t) = - / u(a) da, (4-3) 

t Jo 

we have t a M{u) £ L p ( 0, oo) and there exists a constant c(a,p) > 0 such that 

\\t a M(u) |M (0 ,oo) < c(a,p)||t“u|| L p( 0iOO ). (4.4) 

If Z and W are two Banach spaces, we write Z = W to indicate that they 
are isomorphic and Z C W if Z is continuously embedded in W. 

We shall now give two equivalent definitions of interpolation spaces. 


4.2 Spaces of traces T(p,a,X o,Xi) 

For any atl and p £ [l,oo[ we shall denote by W(p,a,X 0 ,Xi) the set of 
all mappings u : [0, oo[ —> X\ such that 

t a u£L p { 0,oo;X 0 ), t a u' £ L p (0, oo; X\), (4.5) 


where 
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, du 

u = —. 

dt 

When W ( p , a, Xo, X\) is endowed with the norm 

\\ U \\w(p,a,X 0 ,X x ) = II*' U IIlp(0,oo,X 0 ) + II* U IIlj>(0,oo,Xi)> (^'®) 
it is a Banach space. 

Clearly if u € W(p, a, Xo, Xi), then u is a.e. equal to a continuous function 
u in ]0, oo[ with values in X\. We prove now the stronger result. 

Proposition 4.1. Letp > 1, 0 < a+l/p < 1, u € W{p, a, X 0 , X\). Then the 
limit of u(t) exists, as t — * 0, in X\. Moreover, for any T > 0, there exists a 
constant Ct > 0 such that for all t, 0 < t < T, 


M*)Ui < C , T||u||u/(p,c e ,x 0 ,.Yi)- (4.7) 

Proof. We first prove (4.7). Let 0 < a + p~ 1 < 1, q~ x = 1 — p~ l , T > 0 fixed, 
s, t £ [0,T]. By integrating with respect to s, between 0 and T the identity 

s a u{t ) = s a u(s) + s a f u'(a) dcr, 

J S 

we obtain 


u(t) = T a 1 |(a + l) J s a u(s)ds + J a a+1 u'(a)da 


piCK+1 _ ( 


na+ i-- a+ i ]u'(a)da\ 


from which 

Ht)|i <T-“^V + 1) f |s Q tt(s)| ds + 2 f \u(a)\da. 

J o Jo 

As s~ a G L q (0,T), by using the Holder inequality, we find 


|«(t)|l < kT a 1 * P (a+l)||s Q u|| i p(o i oo;.Yo) + ll s Q |U<i(o,T)||s a M , ||Lr(0,oo;A'i) 

and (4.7) is proved. Set now u n (t) = u(t + 1/n); then, as easily checked, u n 
belongs to W(p,a,X 0 ,X i) and u n —> u in W{p,a,X 0 ,X i). Now by (4.7) it 
follows that {u„} is a Cauchy sequence in C([0, T]; Ai) and the limit of u(t), 
as t —> 0, does exist. □ 

We now assume that 0<a+p^ 1 < 1 and consider the mapping 

«h >7 u = u(0): W(p,a,X Q ,Xi) X u (4.8) 

which is well-defined by Proposition 4.1. We define the spaces of traces 
T(p, a, X 0 , Xi) by setting 
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T(p, a, X 0 , Xi) = {x G Xi: 3u G W(p, a,X o, Xi), u( 0) = x}. 

T(p, a, Xq,Xi), endowed with the norm 

\x\T{p,a,X 0 ,X 1 ) = inf{||u||w(p,a,x 0 ,.Yi): «(0) = x}, (4.9) 

is a Banach space. We clearly have 

X 0 cT(p,a,X 0 ,X 1 )cX 1 . (4.10) 

Remark 4.1. If u G W(p,a,X 0 ,X i), then clearly, for any t > 0, u(t) G 
T(p, a, Xq, Xi) and 

K*)|T(p,a,X 0 ,Xi) < ||«||w(p,a,X 0 ,Xi)- (4- 11 ) 

It follows by a density argument that 

u G C([0, oo[; T(p, a, Xo, Xi)) for any u G W(p, a,Xo,X\). (4-12) 

□ 

Proposition 4.2. Letp > 1, 0 < a + l/p < 1. The following statements hold: 

(i) The embedding of T(p, a, Xo,Xi) in Xi is continuous. 

(ii) The embedding of Xq in T(p, a, Xq, Xi) is continuous and dense. 

Proof, (i) Due to the Closed Graph theorem, it is sufficient to prove that the 
embedding 

x e-> x: T(p, a, Xq, X\) —> X\ 

is closable. Let x n —> 0 in T(p , a, Xo, X\) and x n —> y in X\. We have to show 
that y = 0. Let in fact u n € W(p, a, Xo, X\) be such that 

nn.( 0) = X n , ||Wn||w(p,a,X 0 ,Xi) — T \Xn \T(p,a,Xo,X±) • 

This can always be done by definition of the norm in T(p, a, Xq, Xi) as an inf 
(cf. (4.9)). Then u n —> 0 in W(p,a,Xo,Xi), so that by (4.7) x n = u n (0) —» 
0 = y in Xi. 

(ii) Let x € Xo, </> G C' oo ([0, oo[: R) such that (j>{t) = 1 if t G [0, |] and 
f(t) = 0 if t > 1. Setting u = (j>x we have 


\WP(p,a,X 0 ,Xi\ 


= f \t a (f>(t)x\Q dt + f \t a (j)'(f)x\\ dt. < const. 

Jo J o 


It follows that \x\t(p,oi,x 0 ,x) < const.|x|o- This proves the continuity of the 
embedding Xo —> T(p, a, Xo, Xi). 

We now prove the density. Let x G T(p, a, X 0 , Xi). By definition there 
exists u G W(p, a, Xo, Xi) such that u( 0) = x and we can construct a sequence 
e n > 0, e n —> 0, such that u(e n ) G X 0 . For any such £ > 0 define the function 
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Ze{t) 


U e (t ) — u(t), 0 <t<£, 

0 , t > 0. 


By construction 

where X[o jE ] is the characteristic function of the interval [0. e]. Moreover 

IKz'sWlp = ll^w'IU^O.e) 


and t a z' e —> 0 in L p ( 0, oo; X\) as £ —> 0. Similarly is a measurable function 
from [0, oo [ to Xq and we wish to show that the L p -norm of t a z e goes to zero 
as £ —■> 0. By definition 


\\t a Ze || 


P _ 
Lp ~ 



t a j u'(s)dsX[o,e]{t) 



u'(s) ds 


v 

dt 


and for 0 < t < e, 1 < p < oo, and p 1 + q 1 = 1 


u'(s) ds 


< / s~ aq ds 


1/9 


|sV|| iP(t>e) . 


But 1 — aq > 0 and 


because by hypothesis 


re 1 -aq 

/ S - aq ds < - - 

It 1 -aq 


1 — aq = P [1 — p 1 - a] > 
P - 1 


0. 


Therefore 


\\t a Ze\\ P LP < 


P■ 

£ l~~aq T Pi 9 


1 — aq 

Again by hypothesis ap+ 1 > 0 and 


t ap dt\\s a u'\\ p LP . 


because 

Finally 

and 


re F ap +1 

/ t ap dt = -- 

/ 0 ap+1 


ap+l=p(a + p : ) > 0. 
\\t a Ze\\ L P < 


£ (l-aq)l/q £ (ap+l)l/q 


(1 -~aqy/ q (ap + 1) 1 / 9 
1 — aq ap+1 


\s a u'\\ L p 


+ 


= p~ 1 +q~ 1 = 1. 
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This shows that t a z E € T p (0, oo; X 0 , Xi) and 

\\t a z e \\ L p < e(l - aq)~ 1/q (ap + l) -1/9 ||s c V|| p . 

Therefore z £ G W(p, a ; X 0 , Xi) and z £ — > 0. Hence by Remark 4.1 

x n - x = u(e n ) - u(0) = z en (0) -> 0 

in T(p, a; Xq, Xi) as e n — » 0. 

When p = 1, we have by hypothesis — 1 < a < 0 


\t a z e \\ L i = f t a f u'(s)ds dt 
Jo Jt 


Jo [M] 


because 


t < s < e =>t~ a < s~ a < e~ a . 


Therefore because a + 1 > 0 

ll^elUi < —^e-«\\s a u'\W = --\\s a u'\\ L i, 
a + 1 a + 1 

and we reach the same conclusion as for p > 1. This proves the density of Xq 
in T(p, a; X 0 ,Xx) □ 

Example 4.1. Let Xo = H 1 ( R), Xi = L 2 (R), p = 2, a = 0. Then 

W(2, 0,H 1 (R), L 2 (M)) = {ri G L 2 (0, oo; iL 1 (R): u' G L 2 (0, oo; L 2 (R))}. 

For any u G W(2, 0, Ff 1 (IR), L 2 (R)) we set u(t,x) = u{t)(x) and R. 
{(t,i)Gl 2 :l>0}. Then, by Fubini’s theorem, we have 

du du 9 

U ' W G *- +) 

so that u G IL 1 (R^.) and IT(2, 0, H 1 (R.), L 2 (R)) = U 1 (R^_), whereas 

T(2,0, H\R), L 2 (R)) £* H 1/2 (R 2 + ). □ 

We now give the Interpolation Theorem. 

Theorem 4.1. Let Xq —> X\, Yq —> Y) be Banach spaces. Let 

7r G £(X 0 ,Y 0 ) n C{Xi,Y{). 

Then if p > 1 and 0 < a + p^ 1 < 1, we have 

IT G £(T(p, a, X 0 , Xr), Tip , a, Y 0 , Y,)) 


£(T(p,a,X 0 ,Xi),T(p,a,VoXi)) 


< max{||7r||£ (Xo ,Yb), IMUog.Yx)}- (4.13) 


+ M 



4.3 Spaces of averages (Xq, Xi)g, p 

For any 9 € ]0,1[ and any p G [1, oo[ set 
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(*o,*ik P 


and moreover 


I a; G Xu 


3 Ui'. [0,oo[ —> Xi, 
t~ 9 u 0 G L P (X o), 
t'-Oui G Ll{X x ), 

X = Uo(t) = U\{f) 



(4.14) 


kl(X 0 ,Xi)e iP — inf{||t e uo\\L*(x 0 ) + p 1 VlliS(Xi) 

: t~°uo € LP(X 0 ), f 1 " V G Ll{X x )}. (4.15) 


In the variational literature, it is customary to denote by [Xo,Xi]g the space 
(Xq, Xi)g 2 - This notation will be used in Chapter 2 and occasionally in the 
other parts of the book. 

Proposition 4.3. Let p > 1, 0 < a + p _1 <1,9 = a+p _1 . Then we have 


(X 0 ,X 1 ) e>p ^T{p,a,X 0 ,X 1 ). (4.16) 

Proof. We proceed in two steps. 

Step 1. We have 

T(p, a, X 0 , X x ) c (X 0 , Xi)g p. (4.17) 

Let x G T(p, a, Xo, Xi) and u G W(jp, a, Xo, X{) such that x = u(0). Set 

-I/* /r 

1 


= u 0 (t) = u^j, Ui(t)=-J u'(s)ds 

t~ 9 u 0 G LP(X o). 


= x — u 


We first check that 

In fact we have 


= [°° \s e n(s)\P 0 - 
J o s 


p dt 

n t 


s a u(s)\ p ds< \\u\\ p w(p ^ XotXi) 


and (4.19) is proved. Then we check that 

i 1_ % G LP{X x ). 


(4.18) 

(4.19) 


(4.20) 
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We have 


/Vv< - f 

J 0 1 J 0 


a-e 


ni/t 


u'(cr) 


/0 




s 8 1 u'(a)da 

J o 

1 /■* |P 
S a — / u(cr)cr 
S .In 


ds 

s 


poo 

< const. / |s“u , (s)| p (is 

io 

— COnS t- IMIwqp.a^c-X’i) 

due to Hardy’s inequality. Thus the inclusion (4.17) is proved. 

Step 2. We have 

(X 0 ,X 1 ) e , p CT(p,a,X 0 ,X 1 ). (4.21) 

Assume that x = «o(t) + Mi(t) with t~ e uo G L P (X 0 ), t 1 ~ 8 u i € Lf(Xi). We 
first regularize u o and iq by setting 


uo(t) = jf u 0 (s)ds, u\(t) = 7 / ui(s)ds. 
t Jo * Jo 

We still have x = uo(t) + We now set 

u(t) = u 0 = x-U! = t J u 0 {s) ds 

and prove successively that for 9 = a + p~ 1 

t a u G L p (0, oo; Xo), t a u' G L p (0, oo; Xi), u(0) = x. 
This will prove inclusion (4.21). 

We show (4.24). We have 


(4.22) 


(4.23) 


pOO 

|t a w(t)|o dt = / \t 8 ~ 1 ^ p u(t)\ , Q dt 

Jo 


1 1' 


e-i/p+i 


r i/t 


i/p-e-i 


Uo(cr) da | p dt 

I p 


uo(a) da 


t 2 dr 


pOO pT P pOO 

/ t ~ 0 / uo(a)da r _1 dr < const. / \t~ 8 uo{t)\ p 

Jo Jo o Jo 


dt 
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and (4.24) is proved. 

To show (4.24) consider the following identity: 

u'(t) = -j U!(s)ds+ (4.24) 

and set 

poo 

J= \t a u\t)\\dt. 

Jo 

We have J < A 1 / p + B 1 / p , where 

pOO pi/t P poo / 1 \ P 

A= t a u\{(j)da dt, B= t 01 ^ 1 ^ ( - J dt. 

Jo Jo 1 Jo \t J 1 

Now, setting r = t^ 1 and using once again Hardy’s inequality, we have 

pOO -j pT P pOO 

A= t 1 ~ e — / ui(a)d<j r _1 dr < const. / {t 1 ^ 9 u\{t)\\t~ 1 dr 

Jo T Jo 1 Jo 

= const. \\t 1 ^ e ui\\ L P(x 1 )- 

poo 

B= \T 1 ~ 9 U 1 (T)\^T- 1 dT=\\t 1 - 0 U 1 \\ L P { x 1 ). 

J 0 

Thus (4.24) follows. 

It remains to show (4.24). By Proposition 4.1 the limit a = lim t ^ow(i) 

exists in X\. By (4.23) it follows that lim t _o ui(t) = x — a = /?. So we have 

to prove that (3 = 0. By Hardy’s inequality we have t 1 ^ 9 ^i G Ll(X i) so that 
f°° j.p( i-e)-i| ~ i (^)|P ^ < w hfoh implies (3 = 0. □ 

We now prove some inclusions. 

Proposition 4.4. Let p,q G [l,oo[ , 0,w £ ]0,1[; then: 

(i) if p < q, we have {X 0 ,X 1 ) e>p C (X 0 , X^gy, 

(ii) if 6 < u>, we have (X 0 ,Xi)o >p C {X 0 ,Xi) u ^. 

Proof. Let x £ (X 0 ,Xi)g iP , x = u 0 (t) + Ui(t) with t~ 9 u 0 £ L%(X 0 ), t 1 ~ 9 u i £ 
L*(X i). Choose <j> £ 2?(]0, oo[) such that (j>(t) > 0, / 0 °° cj)(s)s~ 1 ds = 1 and set 

Vj (t) = f^ j= 0 , 1 . 

We have a: = Uo(i) + fi(t). Moreover, due to Young’s inequality, 

r e vo g LP(Xo) n L°°(X o) C L«(X 0 ), 
t 1 ~ e vi £ LKXi) n L°°(Xi) c L«(Xi), 


and (i) is proved. Let us now prove (ii). Due to (i) it is sufficient to prove that 
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(*0,*lk„ c (-X’oj 


(4.25) 


Let a; G (Xo,X\)e tV , x— u(0),t a u G L p (0, oo; Xo), t a u' G L p ( 0, oo;Xi), for 
a -l-p” 1 = 0. We can assume u(t) = 0 for any t > 1. Using Holder’s inequality 
we have 

r'uef^O.ooilo), rVei't 0 ,oo;Xl). (4.26) 

In fact we have, for instance 


|f Q lt(t)|g dt 


[ \r- 1 u(t)\ 0 dt = [ r-'-^ruWodt 
J 0 do 

jT s u ~ l ~ a)q ds ,q = /q J o \t a u{t)\ p 0 dt < 00. 


Now (4.26) implies that a: G T(p, w — l,AT 0 ,Xi) = (Xq, Xi) W) i. □ 


4.4 Interpolation spaces between the domain of a linear operator 
A and the space X 

Let X be a Banach space and A be a closed linear operator in X with dense 
domain D(A) in X. We assume that p(A) D ]0,+oo[ and that there exists a 
constant C > 0 such that 

\\R(\A)\\ < p A > 0. (4.27) 

Proposition 4.5. Let p > 1 , 6 G ]0,1[; then we have 

(D(A),X) e , p = {xGX: X 1 ~ e AR{X,A)x G L P {X)}. (4.28) 

Moreover the norm |ar| (d{A),x) Bp is equivalent to 

\x\x + \\X 1 - 9 AR(X,A)x\\ lp{x) . (4.29) 

Proof. The proof proceeds in several steps. 

Step 1. 

We have the following inclusion: 

(D{A),X) e , P c{xGX: X 1 ~ e AR(X,A)x G L P (X)}. (4.30) 

Let x = Uo(t) +ui(t) with t~ 6 uo G L P (D(A)), t 1 ~ 6 u i G L P (X). We have 
t 1 ^ 6 AR(t , A)x = t~ e (t.R(t, A))Auo(t) + t 1 ^ 6 (AR(t, A))ui(t). 

It follows that 

\\t~ e AR{t,A)xr Ll{x) < C P \\t~ e u 0 \\ P L ^ D(A ^ + (1 + C)\\t l - 9 Ul \\ p LUx) 


and (4.29) is proved. 



Step 2. 
We have 
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{x € X: \ 1 ~ e AR(X, A)x G L P {X)} C {D(A), X) e , P . (4.31) 

Assume that t l ~ 0 AR(t, A)x G L P {X) and set 

f° lit <1, if i < 1, 

° | tR(t,A)x if t > 1, 1 | —AR(t,A)x if t > 1, 

so that uo(t) + u±(t) = x. We have t~ e uo G LS(D(A)). In fact 

r°° rh r°° rh 

^ \t- e Mt)\ p D{A)J = l \t 1 ~ e AR(t,A)x\ p j 

= \\t 1 - e AR{t,A)xr LZ(xy 

We finally prove that t l ~ e u\ G L P {X). We have in fact 

rv-vw \ v x ^= f 1 t p ^- i \x\ x dt+ r \t i ~ e AR(t,A)x\ p ^ 

Jo t Jo J 1 ^ 

< || t x ~ B AR{t, A)x\\ p LUx) + p(1 Mx- 

□ 


4.5 The case of a strongly continuous semigroup 

Proposition 4.6. Assume that A is the infinitesimal generator of a strongly 
continuous semigroup S in X of negative type. Then, if p > 1 and 9 G ]0,1[, 
we have 

(D(A),X) e , p = {x£X: t e -\S{f)x - x\ G^(X)}. (4.32) 

Moreover the norm |at| (d(A),x) 9p is equivalent to 

\x\x + ||t f ^ 1 (S'(t)ai - x)\\ L p {X )- (4-33) 

Proof. Again the proof proceeds in several steps. 

Step 1. 


We have 

* G (D(A),X) e , p =► t^iSiOx - x) G L p (X). 


We set 


^(S{t)x 



g{s) ds, 


(4.34) 


0 


(4.35) 
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where g(s) = (/ — S(t — s))u'(s) + S(t — s)Au(s) and u is a function in 
W(a,p,D(A),X), a + p” 1 = 6 , such that u(0) = x. We have 

t a u£ L p (0,oo-,D{A)), 

which is equivalent to t 9 u € LJ(Z?(A)). Therefore t 9 g £ L P (X) so that 
t 9 ~ 1 (S(t)x — x) £ L P (X) by virtue of Hardy’s inequality and (4.34) is proved. 

Step 2. 

We have 

t e -\S(t)x - a) £ LP(X) =>x£ (D(A), X) e , p . (4.36) 

Let v(t) = t 9 ~ 1 (S(t)x — a:) £ L P (X); we have to prove (Proposition 4.5 that 
A 1_e AR(A, A) £ L P (X), which is equivalent to show that 

POO 

AR(X 1 A)x = X / e~ Xs (S(s)x — x) ds. 

J o 

We have 

t 9 ~ 1 AR^,A S jx = t e ~ 2 J e~ s ^ t s 1 ~ 9 v(s) ds = J v(s)ip 

where ^(0 = £ L\(X). By Young’s inequality it follows that 

t 9 ~ 1 AR(l/t, A)x £ L P (X) and the proof is complete. □ 


t \ ds 
s J s 


4.6 The case of an analytic semigroup 

Proposition 4.7. Assume that A is the infinitesimal generator of an analytic 
semigroup S of negative type. Then if p > 1 and 6 £ ]0, 1[, we have 

(D(A),X)d, p = {xeX: t e AS{t)x £ L P (X)}. (4.37) 

Moreover the norm \x\( d(A),x) Bp is equivalent to 


1*1 X + \\t 6 AS{t)x\\L p ,(x)- 

Proof. Again we proceed in several steps. 

Step 1. 

We have 


As 


t 9 AS(t)x £ L P {X) => t-\S(t)x - a) £ L P {X). 


t 1 (S(t)x-x) = f J q 

if t 9 AS{t)x £ L P (X), we have, by Hardy’s in 


AS(s)x ds , 

equality, identity (4.37). 


(4.38) 


(4.39) 
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Step 2. 

If v(X) = A 1-0 AR(X, A) G L P (X), we have t~ e AS{l/t)x G L P (X) and then 
t e AS(t)x € L P (X). The conclusion follows from Young’s inequality and the 
following identity: 

where the path 7 is chosen as in §2.7 (Theorem 2.10). □ 

Remark 4.2. By (4.12) in §4.1, if H is a Hilbert space and A is the infinitesimal 
generator of an analytic semigroup, then 

^ ll 2 ( 0 , T; H ) n L 2 ( 0, T; D(A)) C C([0, T]; D A {\, 2 )), 

where £> A (|,2) = T(2,0; D{A),H) S* (D(H), J?) 1/2)2 . □ 

Example 4.2. Let AT be a Banach space and set £1 = L P (R; X), p > 1. Then 
the linear operator on E defined as 

Au = u', D(A) = W 1 ’ P (R-,X) (4.40) 

is the infinitesimal generator of the semigroup 

( S(t)u)(s ) = u(t + s). (4-41) 

By Proposition 4.6, it follows that u G ( D(A ), X)) g if and only if 

pOO /*+oo 

/ / ^9p-p-t| w (^ _(_ s ) _ m(s)| p dt ds < + 00 . (4.42) 

J 0 J — 00 


We set 

(W^R; X),L p ( R; X)) 0 p = W 1 - 0 *^ R; X), p > 1, 9 G ]0,1[. (4.43) 

□ 


Example 4.3. Let be a Hilbert space and A be a self-adjoint negative oper¬ 
ator on H. Then A is the infinitesimal generator of an analytic semigroup S 
(see §2.2.1). Given the spectral family E\ associated with A, we have 

,° 

AS(t)x = / Xe xt dE\(x), t > 0, x G H (4.44) 

J — OO 

,° 

\AS{t)x\ 2 = X 2 e 2Xt d\E\(x)\ 2 , t > 0, x G H. (4.45) 

J —OO 

Let x G (D(A), 77 ) 0 , 2 - Due to Proposition 4.7, this is equivalent to 
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+OO 

t 20 ~^ASitfxl 2 dt < oo. (4.46) 

On the other hand, we have 

/»+oo rO /* +oo 

/ i 2 *- 1 |AS(i)a;| 2 di = / d|£ A (x)| 2 / \ 2 e 2 X H 20 ~ 1 dt 

J 0 J — oo J 0 

,° 

= r( 2 d) 2 ~ 20 (-A) 2 - 2e d|S A (a;)| 2 

J—oo 

= r(2d)2- 20 \(-A) 1 - 0 x\ 2 , (4.47) 

that is 

{D(A),H)e ,2 — -C , ((-^4) 1-e )» (4.48) 

where (—A) 1 ” 0 is the (1 — d)-th fractional power of the positive self-adjoint 
operator (—A) (cf. F. Riesz and B. Sz.-Nagy [1]). □ 

4.7 The interpolation space [X, Y]g 

In §4 we have described the so-called “real interpolation methods” to construct 
the interpolation space (X, Y)g p . “Complex interpolation methods” can also 
be used to obtain interpolation spaces that are denoted by [X,Y]g. The nice 
feature of [X, Y\g is that it only depends on one parameter. In general real 
and complex methods yield different interpolation spaces (cf. H. Triebel [1, 
p. 15 and pp. 55-59]). However, for p = 2 and two Hilbert spaces X and Y 
such that X C Y, the spaces coincide 

[X,Y] e = (X,Y)g, 2 

(cf. H. Triebel [1, Remarks 3 and 4, p. 143]). 

This discussion is important because in the variational literature, the nota¬ 
tion [X, Y]g is widely used. For instance, in J. L. Lions and E. Magenes [1, 
Volume I, Chapter 1, §15, p. 108 and comments in §17, pp. 113-114], the 
authors use as a definition of \X,Y\g for two Banach spaces X and Y (which 
are contained in a locally convex topological vector space <t>, X C Y C <P, 
with continuous injection of X into Y) 

{ci:a&X + Y, t~ {0+1/2) K(t , a; X, Y) G L 2 (0, oo)}, 

where 

K(t, a; X, Y) = inf [||a 0 ||x + t 2 ||ai ||?,] 1/2 

CL 0 +<2l —CL 

for ao G X and ai G Y. But this coincides with the definition of (X, Y)g t 2 
given by H. Triebel [1, §1.4.2, p. 29]. 

As a result in Remark 4.2 

D A (b 2) = (D(A),H) 1/2t2 = [D(A),H\ 1/2 

and in Example 4.3 (cf. Equation (4.48)) 

[D(A),H] e = (D(A),H)g i2 = D((-A) 1_e ). 
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5 Fractional powers of dissipative operators 

We shall not attempt to duplicate the general theory, which is available else¬ 
where. We simply quote a certain number of definitions and results from 
H. Tanabe [1, Chapter 2, §2.3] and A. Pazy [2, §2.6] for operators defined 
on a Hilbert space H. Our objective is to use this material in §6 to establish 
the connection between the interpolation space [D(A),H]g = (D(A), H)g^ 
and the domain Z?((—A) 1-0 ) of the fractional power of (—A) for the infinites¬ 
imal generator A of a strongly continuous semigroup. It turns out that when 
A is the infinitesimal generator of a strongly continuous semigroup, we shall 
always speak of the fractional powers of the operator —A. To avoid carrying 
a minus sign everywhere, it is customary to present the theory for a general 
operator A instead of —A. With this warning we proceed in the traditional 
manner. 

Definition 5.1 (H. Tanabe [1, Definition 2.3.1, p. 32]). Let A be a closed 
linear operator densely defined in a Hilbert space H . The operator A is said 
to be of type ( w,M ) if: 

(i) 3 w, 0 < u> < 7T, 3 M > 1, such that 

p{A) D {A: | argA] > w}, VA < 0, ||A(A — A) -1 1| < M, 

(ii) and Ve > 0, 3 M e > 0 such that 

|| A(A — A) -1 1| < M s , VA, | arg A| > u> + e. □ 

Remark 5.1. The type (u>, M) of an operator A is not to be confused with the 
type (jJq(S) of a strongly continuous semigroup {5(f)} as defined in (2.8) of 
§ 2 . 2 . □ 

For analytic semigroups {S(t)} such that 

3c > 0, 3a > 0, |S(t)x| < ce _ “*|a:|, \/x € H, (5.1) 

with infinitesimal generator A, (—A) is of type ( u>,M ) for some w < 7t/ 2 and 
M > 0 (cf. Assumption A in §2.7). It is also known that an operator A is 
maximal dissipative if and only if (—A) is of type (n/2, 1). Thus the class of 
operators of type is certainly not empty. 

Assume that A is a linear operator of type on H and that A -1 is 

bounded. In this case, there exists a neighbourhood U of 0 such that 

p(A) D S' {A: | arg A | > to} UU. (5-2) 

With this assumption we can construct a contour r similar to the one in §2.7 
and define for all a > 0 the bounded linear operator 

A"“ = — [ A _ “(A - A) -1 dX. (5.3) 

27T* J r 
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It is easy to see that Ker[A a ] = {0} and that the following definition is 
meaningful for a > 0: 

D(A a ) = R{A~ a ), A a = (A- 0 )- 1 . 

For a = 0, we set A 0 = I. 

Proposition 5.1 (H. Tanabe [1, pp. 35-39]). Given a linear operator A of 
type (u>,M) such that A ^ 1 is bounded, then: 

(i) A a is a closed operator with a dense domain, 

(ii) ifO<a<P, then D(A a ) D D(A 0 ), 

(iii) for all a > 0, P > 0 

A a+0 = A a A 0 = A 0 A a , (5.4) 

(iv) if 0 < a < 1, then A a is of type (au>, M), 

(v) for 0 < a < P < 1, there exists c a j 3 > 0 (dependent only on M, a, P) 
such that 


WuGD(A 0 ), ||A“«|| < Cai/J ||^«|| Q ^||«|| 1 -“^. (5.5) 

We now specialize the above results. 

Definition 5.2. The operator A is said to be accretive (resp. maximal accre¬ 
tive) if -A is dissipative (resp. maximal dissipative). □ 

The reader is referred to §2.6 for a study of the properties of dissipative 
operators. 

Lemma 5.1 (T. Kato [3, Lemma A.6, p. 272]). If A is a closed and maximal 
accretive operator in the Hilbert space H and 

3<5 > 0 such that Vit € D(A), Re(Aii,u) > S(u, u), (5-6) 

then for a, 0 < a < 1, 

Vw € D(A a ), R e(A a u,u) > S a (u,u). (5.7) 

Theorem 5.1 (T. Kato [3, Theorem 3.1, p. 258]). If A is a closed maximal 
accretive operator in the Hilbert space H, then for a, 0 < a < A a is a 
closed maximal accretive operator and 

D(A a ) = D(A* a ) (5.8) 

and there exist constants mi > 0 and m 2 > 0 such that 

Vu G D(A), mi||A Q it|| < \\A* a u\\ < m 2 ||A“u||. (5.9) 

For analytic semigroup such that (5.1) is verified, we have the following 
results. 
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Theorem 5.2 (A. Pazy [2, Theorem 6.13, p. 74]). Let —A be the infinitesi¬ 
mal generator of an analytic semigroup T(t). If 0 G p(A); then: 

(i) T(t): X -» D(A a ), \/t > 0, Va > 0, 

(ii) Vx G D(A a ), T(t)A a x = A a T(t)x, 

(iii) Vf > 0, A a T(t) is bounded and there exist M a > 0 such that 

\\A a T(t)\\ < M a t~ a e~ St , (5.10) 

(iv) for all a, 0 < a < 1, 

3c a > 0, Vx€D(A a ), \\T(t)x-x\\ < c a t a \\A a x\\. (5.11) 

6 Interpolation spaces and domains of fractional powers 
of an operator 

In this section we use the notation [A, Y\g as introduced in §4.7 with X and 
Y two Hilbert spaces with continuous injection of X into Y. 

We have seen that for a negative self-adjoint operator on a Hilbert space, 
it is possible to define the a-th fractional power (— A) a , 0 < a < 1, of —A. 
Example 4.3 in §4.6 shows that the domain D((—A) a ) of the operator (— A) a 
is isomorphic to the interpolation space 

\D{A), H\ i_ a = (D(A), H) t - a , 2 . (6.1) 

The same type of construction can be repeated for maximal dissipative oper¬ 
ators, and J. L. Lions [2] showed that 

D((-A) a ) S* [D(A), #]!_„, 0 < a < 1. (6.2) 

Moreover it was also known (cf. T. Kato [2, Theorem 3.1, p. 258]) that for 
that class of operators 

D((-Ar)=D((-A*r), 0<a<i. (6.3) 

These results were extended by A. Yagi [1] to include differential operators 
that are not generally maximal dissipative. 

In this section we essentially give an English translation of A. Yagi [1]’s 
note to the Comptes Rendus. It is useful to recall the following definitions, 
notation, and relations, which have been used in §3 through §5 (cf. (3.37)- 
(3.38), (4.14)-(4.15)), for a Hilbert space H 

D A (6,2) d ^T(2,9-,D(A),H), 0 < 9 < 1, 

[D(A),H\ e = {D(A),H) e . 2 , 0 < 9 < 1. 

Moreover by Proposition 4.3 we know that for all 9, 0 < 9 << 1 

D a {9, 2) = T(2, 9 ; D{A), H) S* ( D(A),H) e . 2 = [D(A),H] 9 . (6.4) 
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Theorem 6.1 (A. Yagi [1]). Let A be a linear operator of type (u>,M) on a 
Hilbert space H such that A -1 is bounded in H. Denote by A* the adjoint of 
A. Then the following conditions are equivalent: 

(i) for all 9, 0 < 9 < 1, 

D(A 9 ) = [D(A),H]i-g and D(A* e ) = [D(A*),H]i-g-, (6.5) 

(ii) there exists a, j3, 0 < a, [3 < 1, such that 

D(A a )c[D(A),H] 1 - a and D(A^) c [D(A*), H] x _^ (6.6) 

(iii) there exists a, (3, 0 < a,/3 < 1, and there exists constants M a > 0 and 
Mp > 0 such that 

{ 1-00 N 1/2 

J Q A 2Q - 1 ||A 1 -«(A + A)- 1 /||^^j <M a \\f\\ H , v/eff; (6.7) 

f roo 'v 1/2 

|y A 2/3_1 || A*^ 1_/3 ^(A + A)~ l g\\ 2 H dx^ <M* p \\g\\ H , \/g € H. (6.8) 

(iv) the holomorphic function A~ z : {z : Re z > 0} —> £(H, H) (and hence the 
holomorphic function A *(-*)) C an be extended to a strongly continuous 
function from {z: Rex; > 0} to C(H , H). 

Theorem 6.2 (A. Yagi [1]). Assume that A is a linear operator that verifies 
the conditions of Theorem 6.1: 

(i) If there exists 7, 0 < 7 < 1, such that 

V0, 0 < 0 < 7, [D(A),H\ 1 _e = [D(A*),H] 1 _ 0 , (6.9) 

then condition (ii) of Theorem 6.1 is verified. 

(ii) If there exists 7, 0 < 7 < 1, such that 

VO, 0<6»<7, D(A 6 ) = D(A* 6 ), (6.10) 

then condition (iii) of Theorem 6.1 is verified. 

Corollary 6.1. Under the hypotheses of Theorem 6.1 and for some 7, 0 < 
7 < 1, the following statements are equivalent: 

(i) VO, 0 < 0 < 7, [D(A), H\i_ e = \D(A*), H\ x _ e , 

(ii) VO, 0 < 0 < 7, D(A e ) = D(A* e ). 

With the above results and Theorem 5.1 in §5 we can now complete the 
picture for closed maximal accretive operators. 
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Proposition 6.1. Assume that A is a closed maximal accretive operator in 
the Hilbert space H for which A~ l is bounded in H. Then 

D(A e ) = [D(A),H}i-g, D(A* e ) = [D(A*),H]i-g, 0 < 6 < 1, (6.11) 

and 

[■ D(A),H] 1 _ e = D(A 9 ) = D(A* 8 ) = [D(A *), H\ 1 _ e , V0, 0 < 9 < ±. (6.12) 

Proof. From Theorem 5.1 D(A e ) = D(A* e ), 0 < 9 < 1/2. Thus from Theo¬ 
rem 6.2(ii) and the equivalence of (i) and (iii) in Theorem 6.1 we obtain (6.11) 
and a portion of (6.12). □ 

Therefore Proposition 6.1 generalizes the result of Example 4.3 in §4 
for negative self-adjoint operators that generate an analytic semigroup on 
a Hilbert space. 

Using the results of P. GRISVARD [1], we can now complete the theory 
on elliptic operators corresponding to regular boundary problems. We quote 
from A. Yagi [1]. Let U be a bounded open domain in R" with an infinitely 
differentiable boundary T. Let A(x\ D) be a differentiable operator of order 
2 to with infinitely differentiable coefficients in Q. and let {Bj(x; 
be m boundary differential operators of order mj < 2m — 1 with infinitely 
differentiable coefficients on T. Assume that 

(a) A(x; D) is properly elliptic in fi (cf. J. L. Lions and E. Magenes [1, 
Volume 1, Chapter 2, §1.2, Definition 1.2]), 

(b) {Bj(x] is a normal system on T (cf. J. L. Lions and E. Ma- 

GENES [1, Volume 1, Chapter 2, §1.4, Definition 1.4]), 

(c) A{x\D) and {/3j(x; verify the conditions in H. Tanabe [1, 

Chapter 3, Theorem 3.8.1] for 9 = tt. 

Under the above assumptions define an operator A in L 2 (U) as follows: 

D(A) = {u £ H 2m (fl): Bj(x; D)u = 0 on U, 1 < j < m}, 

Au = A(x; D)u. (6.13) 

A is called a realization of A(x\ D) in L 2 (U) under the boundary conditions 
{Bj(x; Its adjoint is given by 

D{A*) = {vG H 2m (fl): Cj(x; D)v = 0 on T, 1 < j < m}, 

A*v = A(x; D)*v, (6.14) 

where { Cj(x ; D)}i<j< m is the adjoint system of {B 3 (x; The space 

D(A) (resp. D(A*)) will also be denoted Lf^ m (fl) (resp. H^J n ( fl)) when they 
are identified with a subspace of H 2m ( f2). In fact from the a priori estimates 
for elliptic operators the two spaces coincide because the graph norm of D(A) 
(resp. D{A*)) is equivalent to the one of H 2m ( fl). 

To check condition (i) in Theorem 6.2, it is sufficient to End a constant 7, 
0 < 7 < 1, such that 
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[H 2 m (Q), H°{Qj ]0 < 0 < 7. (6.15) 

But according to P. GRISVARD [1] or J. L. Lions [3, Volume 2, Chap¬ 
ter 4,Theorem 14.4], the interpolation spaces are specifically characterized 
by 


u g H 2me m ■ Bj ^ D)u = ° ° n r ’ mj < 2md ~ H 
Bj(x;D)u GL 2 _ 1 ^ 2 {^), THj = 2 m9—\ J ’ 

where L^_ 1 ^ 2 (0) denotes the space of functions p such that d(x, r)~ 1 ^ 2 ip G 
L 2 (0). A similar characterization holds for ff°(J7)]i_g. So in partic¬ 

ular for all 9 ,0 < 9 < l/4m, 

[H 2 m (n) : H°(Q)] ± _ g = H 2 ™\ 0) = [H 2m (Q), H°(Q)] . (6.16) 

Hence from Theorem 6.2 (i) 

ye, 0 < 9 < — , D(A e ) = D(A* e ) (6.17) 

4 m 

and from the equivalence of (i) and (ii) in Theorem 6.1 for all 0, 0 < 0 < 1, 
D(A 9 ) = [H 2 B m (n), H°(Q)\ , D(A* 6 ) = [H 2 m (n), H°(Q)] . 
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Variational Theory of Parabolic Systems 


1 Variational differential equations 

A complete treatment of variational differential equations is beyond the scope 
of this book. We shall mainly quote some results from the books of J. L. Li¬ 
ons and E. Magenes [1]. In order to motivate the chosen constructions and 
models, we give a series of classical examples. We assume that the reader is 
familiar with Sobolev spaces and their properties. 

In this chapter we use a notation that is slightly different from Chapter 1. 
This notation is standard in books using the “variational theory.” 

Notation 1.1. Let X and Y be two Hilbert spaces such that X C Y. In that 
case the interpolation spaces (X,Y)g iP with p = 2 and [X,Y]g coincide for 
0 < 6 < 1 (cf. Chapter 1 §4.7). We shall use the notation [ X , Y]g, 0 < 9 < 1. 

□ 

In addition recall that the operator A that will be used throughout this 
chapter will correspond to —A in Chapter 1 whenever it describes the same 
system (cf. Chapter 1, §5 and §6). 

1.1 Distributed control 

Let T > 0 be a real number and let H be a bounded open subset of R" (n > 1, 
an integer) with “sufficiently smooth” boundary r. We use r rather than dfl 
as was done in Chapter 1 because the notation is more in line with the liter¬ 
ature on variational equations. Following J. L. Lions and E. Magenes [1], 
introduce the cylinder 

<3 = n x ]o, t[, s = rx]o,T[, (1.1) 


the coefficients 


(Hj) G L°°(Q), 1 < i, j < n, 


a -o G L°°{Q ) 


( 1 . 2 ) 
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and the bilinear form 





dip dip 

dxj dxi 


dx 


/ ao(x,t)ipip dx. 

Jn 


(1.3) 


1.1.1 Homogeneous Dirichlet boundary conditions 

Choose L 2 (Q) or equivalently L 2 (0, T; L 2 (fl)) as space of control functions u. 
Consider the boundary value problem 

f A (t)y + = u in Qi 

| y = 0 on S, ( L4 ) 

{ y{x,0) = y°(x) in O, 

where 

A(t)<j> = — (o,ij(x, \ + ®o(x, t)4>. (1.5) 

i,j —1 1 ^ ^ ' 

Introduce the spaces 

v = H^(n), H = L 2 {n) (i.6) 

and the continuous dense injection 

i:V^H. (1.7) 

Identify the elements of the dual H' of H with those of H. This results in the 
injections 

V A H = H' 4 V', (1.8) 

where i* denotes the (topological) transposed of the continuous linear injection 


The system of equations (1.4) can now be written as a “variational differ¬ 
ential equation” in V ', the topological dual of V. A more precise definition 
of this terminology will be given in §2. To see this multiply both sides of the 
first equation (1.4) by an arbitrary element v in V and use Green’s formula 
for the term A(t)y 


/ A(t)y(t)v dx = o(f; y{t), v). 
Jn 


(1.9) 


For all v in V 


f dy 

a(t-,y{t),v) + J -Aj-vdx = (u(t),iv), 
y( 0 ) = y°, 


( 1 . 10 ) 


where (•, •) denotes the inner product in H. This readily suggests to interpret 
the time derivative of y as an element dy/dt of V' because the linear functional 
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I -^-v dx = (i*u(t), v)v — a(t; y(t), v): V —> K (1.11) 

Jn Ot 

is continuous ((-,-)v denotes the duality pairing between V' and V). Thus 
(1.10) is equivalent to the following equation in V 

A (t)y + ^=i* u , 2 /( 0 ) = y°, (1.12) 

where A(t) is now interpreted as the continuous linear map from V to V’ 
defined by 

{A(t)<f>, ip) v = a(t, 4>, i)). (1.13) 

The idea is now to look for a solution y of (1.12) in the space 

lT(0,T) = |^Gi 2 (0,T;V): ^GL 2 (0,T;V')}, (1-14) 

where the time derivative must be carefully interpreted as a distributional 
derivative with values in V'. It can be shown that system (1.12) has a unique 
solution y in W(0, T) for every y° in H under the following “coercivity” hy¬ 
pothesis: 


3a > 0 such that Gt", 

n n 

Y. (*>*)&& > a Y a.e. in Q. (1.15) 

i,j =1 i= 1 

From the control point of view, the space of controls is U = L 2 {fl) = H , the 
space of control functions is U = L 2 { 0, T\U ), and the control operator 

B-.U^H (1.16) 

is the identity operator. With this notation system (1.12) can be rewritten as 

A{t)y + ^ = i* Bu , 2/(0) = y°- (1-17) 

In general when the control operator is continuous on H = L 2 (Q) we say that 
it is a “distributed control operator.” 


1.1.2 Homogeneous Neumann boundary condition 


As in the first example we choose control functions u in L 2 (0, T; L 2 (fl)) and 
consider the following boundary value problem: 


A(t)y+^j= u in Q, 


dy 


= 0 on A, 


0v A 

l y(x,0) = y°{x) in O, 


(1.18) 
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where A(t) is given by (1.5), 

v= (zq,... ,z/„) 


is the unit external normal to T, and 


9y 

dv A 




i,j =1 


dy 

dxj Uj 


(1.19) 


is the conormal derivative of y with respect to the operator A. Here we choose 


V = H\n), H = L 2 (n) 


( 1 . 20 ) 


and still denote by i the continuous injection of V into H. We proceed as in 
the first example and obtain the variational differential equation (1.17). To 
obtain the existence of a solution here, we need to add to hypothesis (1.15) 
that 

ao(x,t) > a, a.e. in Q. (1.21) 


1.2 Boundary control condition 

1.2.1 Control through a Neumann condition 

In this example the space of control functions u is L 2 (E) or equivalently 
L 2 (0,T;U ) with U = L 2 {r). The associated boundary value problem is 


A(t)y + || = 0 in Q, 


dy 


= u on E, 


dv A 

{y(x,0) = y°(x) in fl, 


( 1 . 22 ) 


where A(t) is given by (1.5) and dy/dvA is the conormal derivative (1.19) 
with respect to the operator A. We choose the same space V and H as in the 
example of §1.1.2. 

To transform system (1.22) into a variational differential equation in V' 
we again use Green’s formula: For all v in V = 17 1 (H) 

j ^ A(t)y(t)v dx = a(t ; y(t), v) - J v dr 


= a(t; y(t), v) — J u(t)v dr. 


So for all v in V 


i{t;y(t),v) + j -j^vdx = J u(t)vdr, y(0) = y°. (1.23) 
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Here we define the control operator B: U —■> V' as follows: 

(Bu,cj))v = J u(j)\ r dr, ueL 2 {r), (frev. (1.24) 

It is linear and continuous because the trace operator 

(j)\ r :V = H^fl)H 1 ' 2 ^) (1.25) 

and the injection of H 1 / 2 (F) into L 2 (r) are continuous. The final result is 
the variational differential equation 

A{t)y + = Bu ’ y(°) = V°- ( 1 - 26 ) 

By its very nature, B is a “boundary control operator.” It is never a continuous 
linear map on L 2 (Vl). System (1.26) has a unique solution in W(0,T) under 
hypotheses (1.15) and (1.21). 

1.2.2 Control through a Dirichlet condition 

Consider the boundary value problem 

f A{t)y + = 0 in Q, 

| y = u on T, 
l y(x,0) = y°(x) in 12, 

where A(t) is given by (1.5). Here the control enters as a Dirichlet condition 
on r. This problem cannot be transformed into a variational problem by 
integration by parts. We shall see in §2.1 and §2.4 that this more delicate 
problem can be handled by the Method of Transposition. However, after a 
change of variable, it can also be put in variational form. 

1.2.3 Point controls 

Another boundary value problem that is not amenable to a variational equa¬ 
tion by integration by parts is when the control is achieved through a finite 
number of points (or locations) in the domain 12. We shall see in §2.2 and §2.4 
that this problem can be handled by the Method of Transposition for domains 
in R”, n < 3. 

1.3 Main theorem 

The main theorem that we shall quote is one of several isomorphism theorems, 
which can be found in J. L. Lions and E. Magenes [1], Volume 1, Chapter 3, 
Theorem 1.1 and Examples in §4.7]. 
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Let V and H be two Hilbert spaces with the following notation: 

| • | (resp. || • ||) is the norm in H (resp. V), 

H' (resp. V') is the topological dual of H (resp. V), 

(•, •) is the inner product in H, 

(•, -)v is the duality pairing on V' x V. 

We assume that there is a continuous injection i: V —» H and we identify the 
elements of H' with those of H : 

ViffEff'wy'. (1.27) 

Given a fixed real number T > 0 and a family of continuous linear operators 

A(t) £ C(V, V'), 0 <t<T, (1.28) 

we make the following assumptions: 

\/v,w e 7, ( A(t)v,w)v is measurable on ]0,T[ (1-29) 

and for all t £ [0, T], 3c > 0, such that 

\(A(t)v,w) v \ < c|M| : Ml ( L3 °) 

and 3a > 0 and 3A £ R such that 

Vi> £ V, (A(t)v, v)y + A|u| 2 > a||w|| 2 . (1.31) 

Assumption (1.31) is known as the V—H coercivity of A. Define the space 

W(0,T) = £ L 2 (0,T;V): ^ £ L 2 (0,T;W)|, (1.32) 

where the derivative is to be interpreted as a vectorial distributional derivative 
with values in V’. 

Given 

/ £ L 2 (0,T; V'), y° £ H, (1.33) 

we consider the variational differential equation 

A (t) y +^ = f, y(0)=y°- (1.34) 

Notation 1.2. In this chapter we use the notation A(t) of the variational lit¬ 
erature. When A(t) = A (independent of t), the infinitesimal generator of the 
associated semigroup will be —A (cf. Chapter 1, §2.7, Thm 2.10). □ 

Theorem 1.1. Under assumptions (1.27) through (1.33), equation (1-34) has 
a unique solution y in W (0, T) and the map 

y ~ ( A(t)y + §,1/(0)) : W( 0, T) -> L 2 (0, T; V') x H (1.35) 

is an (algebraic and topological isomorphism). 



1 Variational differential equations 179 

Proof. See J. L. Lions [4, p. 116, Theorem 1.2] for the case where V is 
separable. For a more general and modern proof, the reader is referred to 
J. L. Lions and E. Magenes [1, Volume 1, Chapter 3, §4, Theorem 4.1]. □ 

Remark 1.1. It is important to notice that the operators Aft) are neither 
assumed to be self-adjoint nor invertible. In particular when H = R” (n > 1, 
an integer) and the elements of the matrix A are L°°-functions, the V-H 
coercivity assumption (1.31) is verified along with all other hypotheses. □ 

Each element of W(0,T) can be identified with a unique function in 
C([0,T]; H) and the injection 

W(0,T)<-*C([0,T]-,H) (1.36) 

is continuous (cf. J. L. Lions and E. Magenes [1, Volume 1, Proposition 2.1, 
p. 18 and Theorem 3.1, p. 19]). This gives a pointwise meaning to y(t), 0 < 
t <T, as an element of the space H so that y(0) in (1.34) is well defined. 

If we define the adjoint operator A*(t) 

(A*(t)v,w) v = (A(t)w,v)v, (1-37) 


then the map 

v „ ^ A *(t)v - ■ W(0, T) -+ L\ 0, T; V') x H (1.38) 

is also an isomorphism. In §2, we shall see how a smooth version of the “adjoint 
isomorphism’” can be “transposed” to deal with examples that cannot be 
directly modeled by the variational differential equation (1.34). 

1.4 A perturbation theorem 

Theorem 1.2. Assume that the hypotheses of Theorem 1.1 are 
9 G [0,1] and 

K(t): [V,H] e ^ [V, H][_ e , 0 <t<T, 

be a family of continuous linear operators such that 

\/v G [V,H]e, t ^ K(t)v belongs to L°°(0,T; [V, H][_ e ). (1.40) 

Then the operator A + K is V-H coercive and the variational differential 
equation 


verified. Let 
(1.39) 


[A(t) + K(t)}y+^ = feL 2 (0,T-,V'), y(0) = y° G H (1.41) 


has a unique solution y in W(0, T). 
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Proof. It is sufficient to show that A + I\ is V-H coercive: there exist /3 > 0 
and /r £ R such that 

Vv £ V, ([A(t) + K(t)]v,v) v + n\v\ 2 > /3|M| 2 - 
By hypothesis on A 

3a > 0, 3A £ M such that \/v £ V, (A(t)v, v)v + A|u| 2 > a||u|| 2 . 

So for any R 


a-n = ([^(t) + K(t)\v, v) v + n\v\ 2 

> o:||f || 2 + (/x- A)|n| 2 - \\K{t)\\ C (\v,H}e,[V,H}' 1 _ <) )\v\o\v\ 1 -0, 

where \v\g is the norm in [V, H]g. By hypothesis (1.40), there exists a constant 
k > 0 such that 

ess sup \K(t)\ C ([v,H]e,[v,H ]‘;_») - 

[0,T] 

Moreover from J. L. Lions and E. Magenes [1, Volume 1, Proposition 2.3] 
or Proposition 5.1(v) in Chapter 1 (cf. also §4.3) 

Vu e V, \v\ e = \v\ [v ,H] e < c||v||>r- e . 

Therefore there exists c > 0 such that 


k\v\e\v\x-e < c||v|||w| 


and 


c||u|||u| = 2c l\I^W v \\\f^\ v \ < c 
2 v c \ a 


tM +-N 

4 a 


= 7\ v \\ +—M 

4 a 


Finally 


>a|M| 2 + („-A)M 2 --|M| 2 - 


-l»l 2 = 

a 4 


/i - A -I \v[ 

a 


for fi > A + c 2 /a. So we can choose f3 = 3a/4, and this completes the proof 
of the V-H coercivity of A + K. □ 


1.5 A regularity theorem 

We now present a regularity result for variational differential equations due to 
C. Bardos [1]. This type of result is useful at various stages in the analysis of 
optimal control problems. It can also be used in the construction of “smooth 
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adjoint isomorphisms” that are the primary ingredients in the “Method of 
Transposition.” 

We go back to the definitions, notations, and hypotheses (1.27) to (1.32) 
of §1.3. We denote by 

A\(t) = A(t) + XI (1.42) 

the operator associated with the A for which the V-H coercivity assumption 
is verified. So for each t 

A\(t) G C(V, V') (1.43) 

is an isomorphism that also induces an isomorphism 

A x gC(L 2 ( 0,T;V),L 2 (0,T;W)), (A x v)(t) = A x {t)v(t). (1.44) 

For each t € [0,T], we define the domains of A(t), A, A x (t), and A x 

D(A(t)) ={veV: A(t)v G H}, 

D(A) = {w G L 2 { 0, T; V): Aw G L 2 (0, T; H )}, 

D(A x {t)) ={v€V: A x (t)v£H}, 

D(A X ) = {w G L 2 { 0, T; V ): A x w G L 2 (0, T; H)}. 

It is readily seen that 

D(A x (t)) = D(A{t )), D(A X ) = D(A). (1.45) 

The unbounded operator 

A\(t) : D(A{t)) - H (resp. : D(A) - L 2 (0, T; H)) (1.46) 

is an isomorphism when D(A(t,)) (resp. D(A)) is embedded with the graph 
norm topology of A(t) (resp. A) (cf. T. Kato [2], T. Kato [3], J. L. Li¬ 
ons [2]). 

Define the adjoints A*(t) and A* of A(t) and A 

(A* (t)v,w)v = (A(t)w,v)v j \/v,wGV, 

(A* f,g)L 2 (o,T-v) = {Aqt f) V/, g G L 2 (0,T; V). 

Similar definitions for A x (t) and A x yield 

A* x (t) = A* (t ) - XI, A* x = A* x - XI. 

Moreover, for t G [0, T], A x {t) and A x are isomorphisms 

A* x (t) G C(V,V'), ^ G £(L 2 (0,T; V),L 2 (0,T; V')). 

As we did for A define 

D(A*(t )) = {v € V: A*(t)v G H}, 

D(A*) = {/ G L 2 (0, T; V ): A* f G L 2 (0, T; H)}. 


(1.47) 

(1.48) 

(1.49) 


(1.50) 
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Analogous definitions for A x (t) and A\ yield 

D(A* x (t)) = D(A*(t)), D(A* X ) = D(A*), (1.51) 

and the unbounded linear operator 

A* x (t): D(A*(t)) —> H, A* x : D(A*) —> L 2 (0,T;If) (1.52) 

are isomorphisms when D(A*(t)) and D(A*) are endowed with their respec¬ 
tive graphs norm topology. 

The adjoint of A x (t)* (resp. A^) can be considered as an extension of A x (t) 
(resp. A a ) because it coincides with it on D(A x (t)) (resp. D(A X )). With that 
convention the linear maps 

A\(t) G C(D(A{t)),H) n C(V, V ') n C(H,D(A*(t))'), 

A a G C(D(A),L 2 ( 0, T; H )) n C(L 2 { 0, T; V), L 2 (0, T; V’)) 

IT £(L 2 (0,T; H), D(A*)') (1.53) 

are isomorphisms. Similarly, 

A* x (t) G C(D(A*(t),H) n C{V, V') nc(H,D(A(t)Y), 

A* x G £(£>(A*),L 2 (0,T;i?)) n£(L 2 (0,T; V),L 2 (0,T; V ')) 

fl £(L 2 (0, T;H), D{A)') (1.54) 


are isomorphisms. 

Remark 1.2. It is possible to interpolate between the different isomorphisms 
(1.53). So for each a G [0,1] the maps 


A x (t) G C([D(A(t)),H] a , [£>(A*(t)),JT];_ Q ), 

Aa G £([£>(A), L 2 (0, T; #)]<«, [D(A*), L 2 (0,T; H)][_ a ) 


(1.55) 


are isomorphisms. However it is generally not true that 

[D(A x (t)),H] 1/2 =[D(A* x (t)),H] 1/2 = V 


or 


[D(A x ),L 2 (0, T; H)\ 1/2 = [D(A* X ), L 2 (0, T; if)] 1/2 = T 2 (0, T; V). □ 

As Aa(£) is maximal positive (that is, — A x (t ) is the generator of a strongly 
continuous contraction semigroup), the fractional powers A“(f) and A^ a (<), 
0 < a < 1, are well defined (cf. Part II, Chapter 1, §5 and T. Kato [1, 
T. Kato [2]). They are also isomorphisms 

A“(t): D(Af(t)) - H, A x a (t): D(A*«(t)) H , 

A“ : D(A a x ) L 2 ( 0, T; 17), A*« : I4(A*“) A 2 (0, T; if) 


(1.56) 
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whose domains coincide with the appropriate interpolation spaces (cf. Part II, 
Chapter 1, §6, Proposition 6.1) 

D(A<Z(t)) = [D(A(t)),H] 1 _ a , D(A^) = [D(A),L 2 (0 : T- 2T)]i_ a , 

D(A* x <*(t))=[D(A*(t)),H] l a , D(Ar) = [ J D(A*),L 2 (0,r;F)] 1 _ a . 

Remark 1.3. In view of Remark 1.3 and (1.56)—(1.57), for all a G [0,1] 

A x (t) G C(D(Al- a (t)),D(Al a (t))'), A a g C(D(A{-*),D(A* x <*y). (1.58) 

□ 


J. L. Lions [2] has shown that 



D(A a x (t))=D(A* x a (t)), 0<a<i 

(1.59) 

and given sufficient conditions under which 



D{A]!\t)) = D(A* x 1/2 (t)) = V. 

(1.60) 

One of them is 

D(A* x (t)) = D(A x (t)); 

(1.61) 


another one is more technical but covers the so-called regular elliptic boundary 
value problems. 

Theorem 1.3. Assume that there exists a Hilbert space X, X C H, such that 


V is a closed subspace of [X,H]\/ 2 , D(A\(t)) C X, D(A x (t)) C X. (1.62) 
Then 

[D(A x (t)),H] =D(A\' 2 (t))=V, 

/o (1.63) 

[D(A* x (t)),H] 1/2 = D(A* x l/ \t)) = V. 

Proof. Cf. J. L. Lions [2, Theorem 6.1, p. 238] and Proposition 6.1 in Part II, 
Chapter 1, §6. □ 

Example 1.1. Let 12 be a bounded open subset of R" with smooth boundary 
r. Let V be a closed subspace of H m ( 12) such that 


iL™( 12) c P C ir m (12). 

Assume that A(t) = A is generated by the bilinear form 
a(u,v) = / a pq {x)D q uD p v dx, 

\p\,k\<m Jn 

(Au, v)v = a(u, v), 

3a >0, \/v G V, a(v,v) > a||w|| 2 


(1.64) 
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for sufficiently smooth functions a pq on f l and an appropriate choice of V (cf. 
J. L. Lions [2, Section 6.2, p. 239] for more details). 

The triplet {V, H,a(u,v)} is said to be “regular” if 

D(A) C D{A*) c H 2m (n). (1.65) 

□ 

Remark 1.4. (1962, J. L. Lions [2, Remark 6.1, p. 240]) It is important to 
recall that for mixed boundary value problems the relationship (1.63) does 
not hold. For instance it is not known whether 

D(A 1/2 ) =D(A* 1/2 ) 

is true for a second-order elliptic operator that is not self-adjoint with a Dirich- 
let condition on part of the boundary and a Neumann condition on the other 
part. This also applies to the Dirichlet boundary value problem with an irreg¬ 
ular boundary. □ 

Remark 1.5. In 2002, P. Auscher, S. Hofmann, J. L. Lewis, and Ph. Tcha- 
MITCHIAN [1] proved Kato’s conjecture for elliptic operators on R n . More pre¬ 
cisely, let M = M (x) be annxn matrix of complex, L°° coefficients, defined 
on R n , and satisfying the ellipticity (or “accretivity”) condition 

A |£| 2 < Re M £ • f and \M£ • C*| < A |f| |C|, (1.66) 

for £, ( in C" and for some A, A such that 0 < A < A < oo; that is, = 

J2j,k a j,k(x)tk(j- Define 


Af = — div(MV/), (1.67) 

interpreted in the usual weak sense via a sesquilinear form. Under the accretiv¬ 
ity condition (1.66), one can define a square root A 1 / 2 = \J~A. They establish 
that the domain of the square root of A is the Sobolev space in any 

dimension with the estimate || \/)A/|| 2 ~ || V/H 2 - A version of that result also 
holds for an operator A with lower order terms (Theorem 6.1). □ 

In view of identities (1.59), we can rewrite the isomorphisms (1.58) as 
follows: For 0 < a < \ 

A x (t)&C(D(A\- a {t)) 1 D(Al{t))') : A x eC(D(A\~ a ),D(A a x y). ( 1 . 68 ) 

Al(^)G£(D(Af-“ ) (^),^(^r(^)) , )^Ae/:(D(Af- a) ),D(Ar) , )• (1-69) 

The next proposition completes the picture. 

Proposition 1.1. Assume that 

D(A\ /2 (t)) = D{A{ 1/2 (t)). 


(1.70) 
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Then 


and 


[D(A(t)),H] 1/2 = D(A\' 2 (t))=V, 
[D(A*(t)),H] 1/2 = D(A* x 1/2 (t)) = V, 


(1.71) 

(1.72) 


□ 


4 /2 (t) G £(V,H), A* 1/2 (t) G C(V, H) 

are isomorphisms. 

Proof. Cf. J. L. Lions [2, Corollary 5.2]. 

Corollary 1.1. The following maps are isomorphisms: 

A\ /2 (t) g c(D(A(t)), v) n ay, H) n C(h, v') nc{v',D(A*(t))'), 

Al 1/2 (t) G c{D(A*{t))y) n av, h ) n c(h, v') n c(v', D(A(t))') 

A 1 / 2 G C{D(A), v) n £(v, W) n an, v') n £(v\ D{A*)'), 
a* x /2 G ao{A*), V) n £(V, W) n £(W, v') n£(V',£>(A)'), 

where 

V = L 2 (0,T;V), H = L 2 (0,T;H) = n', V = L 2 (0, T; V')- (1-75) 

Given two Banach spaces X and Y and a continuous dense injection i from 
X to Y, define 


(1.73) 

(1.74) 


W(0,T- X, Y) = | ye L 2 (0, T ; X): ^ G L 2 (0,T; Y)|, (1.76) 

where dy/dt is to be interpreted as the vectorial distributional derivative of 
the function iy, ( iy)(t ) = iy(t). Similarly let 

W(0,T-D(A),H) = jy G D(A): ^ G L 2 (0,T;i7)|. (1.77) 

Our next objective is to show that under appropriate conditions on Aft), the 
linear operator 

A\ /2 : W{ 0, T; D{A),H) -► W(0, T; V, V') (1.78) 

is an isomorphism. This will first necessitate giving a meaning to the time 
derivative A\(t)' of the operator valued function A\(t). 

Proposition 1.2. Assume that hypotheses (1.27) to (1.31) and hypothesis 
(1.71) are verified. Assume that the operator-valued function 

A: [0, T] —> C(V, V') (1.79) 


has a derivative A(t)' in Oy,V') almost everywhere in [0,T] such that 
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3c > 0, \\A(t)'\\c(v,v') < c, a.e.in[0,T] (1.80) 

and for all v and w in V 

t (A(t)v,w)v belongs to W 1 ’ 00 ( 0,T;R), (1.81) 

~j^(A(t)v,w) v = {A{t)'v,w) v . (1.82) 

Then : [0, T] —> C(V,V') has a derivative A^ 2 (t)' G C{V,V') almost 
everywhere in [0, T] such that 

3c > 0 , \\A\ / 2 (ty\\ c{ v,v>)<c (!-83) 

and for all v and w in V 

1 1 —> {A^ 2 (t)v, w)v belongs to W 1,oo (0,T;M), (1-84) 

/2 {t)v,w) v = {A\ /2 (t)'v,w}v (1-85) 

Proof Minor adaptation of C. Bardos [1, Proposition 1.1]. □ 


1 /2 

This proposition gives a meaning to the derivative A x (t)' of the operator 
valued function A^ 2 {t). 

Example 1.2. When Aft) is given by a bilinear form 


where 


then 


^ du dv 

i(t;u,v)= 2^ — — + a 0 {x,t)uv, 

i,j =1 3 1 


ao, -gjr € L°°(Q), atj G W 1,00 (Q), 


, ... . . da*.,-, . du dv dan, 

(A'(t)u,v)v= + 


i,j =1 




at 


and conditions (1-73) and (1.74) are verified. 


□ 


Let y belong to W(0, T; D{A\) 1 H). Then from Proposition 1.1, A^ 2 y G 


L 2 (0,T;F). In view of Propositions 1.2 and 1.1 

S-bV = < 2 f+ (<Y»ei 2 (0.r;n 


( 1 . 86 ) 


because 

^ei 2 ( 0,T;iJ) =► Af^£L 2 (0,T;n 

i/G L 2 (0,T;.D(3l A ))cL 2 (0,T;P) =► (4 /2 )'y G L 2 (0, T; 17) C L 2 (0, T; V')- 
By construction, the mapping is continuous. The surjectivity is obvious. 
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Proposition 1.3. Under hypotheses (1.27) to (1.31) and (1.71) on A and 
hypotheses (1.80) to (1.82) on A', the linear map 

A 1 / 2 : W( 0, T; D(A X ), H) -► W( 0, T; V, V') (1.87) 

is an isomorphism. 

Corollary 1.2. Under the hypotheses of Proposition 1.3, is also an iso¬ 
morphism from W(0, T; P, V 7 ) to W(0,T; H, D(A* X )'), where 

W(0,T;H,D(Al)') = {yeL\0,T;H):^eD(Al)'y ( 1 . 88 ) 

We finally quote the regularity result from C. Bardos [1]. 

Theorem 1.4. Assume that hypotheses (1.27) to (1.31) and (1.71) on A and 
hypotheses (1.80) to (1-82) on A! are verified. Consider the variational differ¬ 
ential equation 

A(t) y + ^=f, y(0) = y° (1.89) 

for f in L 2 ( 0, T ; H) and yo in V: 

(i) Then (1.89) has a unique solution y in W(0,T; D(A\), H) and the map¬ 
ping 

y ~ (A(t)y + ^,y(0)y. W(0,T-,D(A x ),H) ^ L 2 (0 ,T-,H)xV (1.90) 
is an isomorphism. 

(ii) Moreover if D(A\(t)) is independent oft, the solution y of (1.89) belongs 
to C([0,T]-,V). 

Proof. Slight adaptation of the proof of C. Bardos [1] or directly by using 
the isomorphism A x of Proposition 1.3, Theorem 1.2 and Theorem 1.1. □ 

Corollary 1.3. Assume that the hypothesis of Theorem 1.3 are verified. Then 
the mapping 

^A^t)v-^,v(T)y.W(0,T-,D(Al),H)^L 2 (0,T-,H)xV (1.91) 

is an isomorphism. 

Remark 1.6. The isomorphism in part (i) for time-varying systems is to be 
compared with the ones in Theorem 3.1 in Chapter 1 and Theorem 1.1 in 
this chapter for time-invariant analytic semigroups in a Hilbert space and the 
so-called maximal regularity results. □ 
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Example 1.3. Let be a bounded open subset of R" with a C°° boundary. 
Let a(t;u,v) be the bilinear form (1.3), 

V = (A(t)u,v)v = a(t;u,v). 


Assume that 


ao, 


w €L ~w> 


e W^°°(Q), 


1 < i, j <n, 


and 

n n 

3a >0, € R n , £ ay ( x , t)&& >aJ2^l 

i,j =1 4=1 

The operator A is V-H coercive. Moreover for all u, v in V 


((A(t))'u,v) v 


dai o < + \ du dv , da ° < 

A -ar M a^a^ + ~ar {x ’ t)uv 

1,3 = 1 


belongs to L°°(0,T;R) and (A(f)) , verifies (1-79) and (1.80). Moreover 


f#(fi) = v c H\n) 

and 

D(A* x (t)) = D(A x (t)) = H 2 { O) n C H 2 (n). 

So the last corollary applies to this problem. Here 

D(A* x ) = L 2 (0,T;D), D = H 2 (fl)nH^(n) 
and the isomorphism (1.90) goes between the spaces 

W{ 0, T; D, H) -r L 2 { 0, T; H) x V. 


□ 


The reader interested in additional regularity theorems is referred to The¬ 
orems 1.2 and 1.3 in C. Bardos [1], which essentially say that under appro¬ 
priate hypotheses on A(t)' , additional regularity in the space or time variables 
yields additional regularity in the solution. When A(t) = A is time-invariant, 
we recover the usual results. 


2 Method of Transposition 

2.1 Control through a Dirichlet boundary condition 

As in the example of §1.2.2, the space of control functions u is L 2 {E) or 
equivalently L 2 (0,T; U) with U = L 2 (r). The boundary value problem is 
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A{t)y + — =0 in Q, 

\y = u on S, (^'1) 

[y(x,Q) = y°(x) in O, 

where A(t) is given by (1.5) with the following hypotheses on the coefficients: 

«o G L°°(fi), a i:j G 1 < i, j < n, (2.2) 

and the coercivity (1.15). We also set V = H = L 2 ( fi), and define the 

injection i as in (1.7) and (1.8). 

In this example it is not possible to directly obtain a variational differen¬ 
tial equation in V' . The method that naturally arises in this context is the 
“Method of Transposition.” To see this it is useful to perform the following 
formal computation. Pick an arbitrarily sufficiently smooth function v(x, t) 
defined on Q such that v(x, t) = 0 on S. Multiply the first equation (2.1) by v 
and integrate over Q. Use Green’s formula twice on the term A(t)y and inte¬ 
gration by parts on the term dy/dt. The result is as follows for all appropriate 
functions v: 


A* {t)v — 


dv 

dt 


dxdt+ / y(T)v(T) dx 
Jn ' 


f dv 

J E U du A , 


dS + f y°v( 0) dx, (2.3) 

Jn 


where 


A*(t)ip = - ^2 ( a ij(x,t)^-\ + a 0 (x,<)V> in fl (2.4) 

i,j —1 3 \ 1 / 


and the co-normal derivative with respect to the operator A * is given by 


dv , , , , dv / \ / \ r-, 

(x,t) = 2_^ aij(x,t) — (x,t)Vi{x) on 27, 


Ova 


i,j —1 


(2.5) 


with v = (i>i ,..., v n ) the unit external normal to r. In the form (2.3), the 
data y° and u explicitly appear in the equation and the unknowns are 


y, y(T). 


( 2 . 6 ) 


In the process we have exhibited the two terms that usually appear in the 
adjoint system 

V{T) ■ (2 - 7) 

If we introduce the space 

H 2 ’\Q) = L 2 (0,T; ff 2 (fi)) n H 1 (0, T; I/ 2 (0)) 


( 2 . 8 ) 
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and its subspace 

<P = {v € if 2,1 (Q): v\ s = 0}, 

then under appropriate assumptions we shall see that the map 

v ~ ( A*{t)v - ^MT)j ■■$^L 2 (Q)x H'(Q 1) 

is an isomorphism. Moreover for 

u G L 2 {£) and y° G 

the linear map 

f dv 


v i—► / u 


dv A 


— dS + f y°v(0)dfl:<P 
* Jn 


(2.9) 

( 2 . 10 ) 

( 2 . 11 ) 

( 2 . 12 ) 


is continuous. 

If we denote by V a the isomorphism (2.10) and by t the continuous linear 
functional (2.12) on <?, equation (2.3) is now equivalent to find 

y=(y,yT)GL 2 (Q)xH-\n) (2.13) 

such that 

{y,'E > aV) L 2(Q) x Hi(Cl) = VvG<P. (2-14) 

But this is equivalent to find y in (L 2 (Q) x I^o(^2)) , such that 

(V a )*y = t in <P'. (2.15) 


This problem has a unique solution because the transposed of the isomorphism 
T> a is also an isomorphism. 

So the idea behind the Method of Transposition is to construct a “smooth” 
adjoint isomorphism and transpose it in order to make sense of the original 
boundary value problem for “rougher” data. When data are smoother we 
naturally recover the usual results. 

The other ingredient associated with the Method of Transposition is the 
theory of interpolation, which enables us to “interpolate” between a “smooth” 
and a “rough” version of the same isomorphism. 


2.2 Point control 

Let {xi, X 2 , • ■ •, Xn} be a set of points in the domain f l. Consider the boundary 
value problem 

f ~ n 

A (t)y + = ^2 5(xi)ui(t), 

i=1 

y\s = o, 

, 2/0*5 o) = y° (x), 


< 


(2.16) 
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where A(t) is given by (1.15) with hypotheses (2.2) and (1.15), 6(xi) is the 
Dirac delta function at a;*, 1 < i < N, and iq: [0, T] —* R, 1 < i < N, are the 
components of the control function u: [0, T] —» U with U = R w . 

By repeating the construction in the previous section, it is easy to show 
that (2.16) is equivalent to 


A*(t) v 


dv 

dt 


dxdt+ / y(T)v(T)dx 


j-T N 

/ Y Ui(t)v(Xj,t) dt. 

J 0 i=1 


+ f y°v( 0) dx 
if! ' 


(2.17) 


for all v in <P. The right-hand-side of (2.17) is a continuous linear functional 
on <P when the map 


,-T N 

vi —> / y; Uj(t)v(xj,t) dt + 
x=i 


y°v(0)dn: d> 


(2.18) 


is continuous. This happens when y° belongs to H~ 1 (Cl) and when the eval¬ 
uation map 

w i—► w(xi): —> R (2-19) 

is continuous, that is when the dimension n of the space 1" that contains D is 
less or equal to 3 (cf. J. L. Lions and E. Magenes [1, Volume 1, Theorem 9.8, 
p. 45] . As a result for dimensions n = 1,2, and 3, we can use the Method of 
Transposition. 


2.3 Main result 

In its crudest form the technique used in the previous examples rests on the 
following classical lemma. 

Lemma 2.1. Given an (algebraic and topological) isomorphism C: X —> Y 
between two real Banach spaces X and Y, its transpose C *: Y' —» X' is also 
an isomorphism between the topological dual spaces Y' and X' for Y and X 
endowed with their respective norm topologies. Hence for each x' in X', the 
variational equation 

(C*y\x)x = (x',x)x Vx£x (2.20) 

has a unique solution y' in Y' that is equal to {C*)~ l x r . Moreover the solution 
is continuous with respect to the datum x'. 

Proof. Cf. N. Dunford and R. S. Schwartz [2, Vol. 1, p. 479, Lem. 7]. □ 
There are many ways to exploit the transposition of a smooth adjoint 
isomorphism. For instance, the reader is referred to J. L. Lions and E. Ma- 
GENES [1, Volume 1] for applications to elliptic (Chapter 2, §6, p. 166) and 
parabolic problems (Chapter 3, p. 225). Recently this technique has also been 
used by M. C. Delfour [1] for systems with delays in state and control 
variables. 
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2.4 Application of transposition to the examples of §2.1 and §2.2 


We now make precise the constructions of §2.1 and §2.2. Define 

H 2 ' l {Q) = L 2 (0,T;H 2 (il)) n£T 1 (0,T;L 2 (n)), 

@ = {v £ 7J 2,1 (Q): v\e = 0} 


and consider the continuous linear map 

v^C a v= A*(t)v - :$^L 2 (Q)x H^Q), 

where for all if in H 2 (Ci) 


A*m 


Assume that 



„ da ° a to 
“°’¥ a 


'(Q), 


G W^°°{Q) 


+ ao(x,t)ip. 


1 < i,j < n, 


and 

n n 

3a >0, V£ G R n , E aij(x, t)£i€j > a £ a.e. in Q. 

i,j= 1 i— 1 


( 2 . 21 ) 

( 2 . 22 ) 

(2.23) 

(2.24) 

(2.25) 


Then A* is V-H coercive. 

Lemma 2.2. Assume that f l is bounded C°° domain and that the a’s verify 
properties (2.24) to (2.25). Then the map C a is an isomorphism. 

Proof. Cf. C. Bardos [1], L. Tartar [1], and A. Bensoussan and J. L. Li¬ 
ons [1], □ 

The map C a is the isomorphism we shall transpose. Introduce the addi¬ 
tional notation 


v = h£{Q), d = H 2 {n) n-ff^fi), H = L 2 (n). ( 2 . 26 ) 

Given any two Hilbert spaces X and Y with a continuous linear injection from 
X into Y, we define the space 

W (0,T;X, Y) = jv G L 2 (0, T ; X) : ^ G L 2 (0,T;F)J. (2.27) 

Notice that coincides with the space W(0, T; D , H). 

Remark 2.1. In fact Lemma 2.2 can be obtained directly from the Corollary 
to Theorem 1.4 and, in addition, because 
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D(A\(t)) = D (independent of t) 

the solution of 

A*(t)v- — =feL 2 (0,T-,H), v(T) = v t &V 

belongs to C(0,T;V). □ 

We also know from interpolation theory (cf. J. L. Lions [2]) that 

[d,h\ 1/2 = [H 2 {n)r\H%(n),L 2 (si )] 1/2 = h£(si) = v. (2.28) 

Consider the following functional to on L>: 

w(u) = f (f{t),v(t)) D dt + (y°,v(0)) v (2.29) 

Jo 

for / in L 2 (0,T; D') and y° in V', where (-,-)x denotes the duality pairing 
on X' x X. The functional 10 is linear and continuous. So we conclude from 
Lemma 2.1 that 

3 a unique (y,yr) € (L 2 (Q) x Hq( f2)) / = L 2 {Q) x V' (2.30) 

such that for all v in L> 

J (y,A*{t)v-^jdt+{y T ,v(T)) v = J {f,v) D dt+(y°,v{ 0))y. (2.31) 

So we are now ready to refine this first result. 

Proposition 2.1. Under the hypotheses of Lemma 2.2, the map 

V~T>y=(^A*(t))*y+^,y{0)y.W{0,T-,H,D') 

^i 2 (0,T;D')xF' (2.32) 

is an isomorphism. Moreover, we have the following identity: 

for ally £ W(0,T; H, D’) and v e W(0,T;D,H) 

J (y,A*{t)v dt +(y{T),v{T))v 

= jyyA*(t))*y + ^,v^dt + (y( ;0),«(0)) v , (2.33) 

where y( 0) and y{T) are to be interpreted as values of the function y in 
C'(0,T;P') 1 , which is almost everywhere equal to y in W(0,T;H,D') (here 
( A*(t )) denotes the topological transposed of the linear map A*(t): D —> H). 

1 Recall the notation C(0,T;V r ) for C([0, T]; V'). 
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Proof. We have seen that the pair (y, y?) is the unique solution of the equation 

J (y,Adt +(y T ,v(T))v 

(f,v) D dtt + (y°,v(0)) v , \/v£$. (2.34) 

Let v(t) = ip(t)w for some w in D and <p in 2?(]0, T[). The function v belongs 
to i> and its substitution in (2.34) yields 

L = J Q (/W “ {A*(t))*y,w)<p(t)dt. 

But the right-hand-side is precisely the definition of the distributional deriv¬ 
ative D t y for the vector distribution y: 

{y(v),w) D = j ( y(t),w) H <p{t)dt , (D t y(ip), w) D = — J (y(t),w) H ^{t)dt. 
From (2.34) we conclude that 

y(t),w) H = (fit) - (A*(t))*y,w) D 

=► D t y = f(t) - (A*(t))*y e L 2 (0,T-,D'). (2.35) 

Therefore y belongs to W(0, T; H, D') as predicted. Moreover the injection 

W(0,T-,H,D') -> C(0,T;V') (2.36) 

is continuous (cf. J. L. Lions and E. Magenes [1 , Volume 2, p. 34, Theo¬ 
rem 6.2]) because 

[h,d'] 1/2 = [d, Hf 12 = [H 2 (n)nHt(n),L 2 (n)] 1/2 = H^ny 

(cf. J. L. Lions and E. Magenes [1, Volume 1, p. 204 and p. 178]). As a 
result y in W(0, T; H , D') is almost everywhere equal to a continuous function 
y in C(0, T; V') and y( 0) and y{T) make sense as elements of V'. 

Going back to (2.34) and substituting (2.35) into it we obtain 

/ + dt = (y T ,v(T)) v - (y°,v(T)) v . 

Choose v(t) = wrp(t) for some w in D and if in iL 1 (0,T;K) and substitute it 
into the previous equation: 



J | (y(t),w)H^{t) + (D t y,w) Dipif) | dt 

= (yr, w) v ip{T) - ( y° , v(0)) v ^(0). (2.37) 
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Recall from (2.35) that 

(D t y, w) D = 4( y(t),w) H G L 2 (0,T;R) 
at 

so that (2.37) reduces to 

/ dt = (yT,w) v ijj{T) - (y°,vm v m- 

As for each w the map 

t ^ ( y(t),w) H 

belongs to H 1 ( 0, T;R), we conclude that 

(Vt,w) v = (y(t),w) H | t=T , (yo,w)v = {y(t),w) H \ t=0 . (2.38) 

It remains to interpret the right-hand sides in (2.38) correctly because in 
principle y £ L 2 (0,T; H) has no pointwise character. However we know that 
the injection (2.36) is continuous and that the function 


1 1 ^ y(t) = i* v y{t) 

is continuous on [0,T] with values in V'. So (2.38) yields 

VT = y{T) e V' and y(0) = y° G V'. (2.39) 


This shows that V as defined in (2.32) is indeed an isomorphism. This com¬ 
pletes the proof of the Proposition. □ 

If we go back to the Dirichlet boundary control to §2.1 and to (2.3), we 
have to show that the linear map 


v 



dS: L 2 (0,T; D) 


R 


is continuous. Indeed for almost all t , the map 


dw 

w ^ a- 

OVA-(t) 


d = h 2 (q) n H\n) -> H 1 / 2 (r) 


and the injection of H 1 / 2 (T) into L 2 (r) are continuous. This defines the 
control operator B(t ): U = L 2 (r) —> D' as follows: 

(B(t)u,w) D = (u, dW ) (2.40) 

V d ^A-{t)J L 2 {n 

and the adjoint operator B*(t): D —> L 2 (r) 

dw 

dvA*(t) 


B* (t)w 


(2.41) 
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They are both linear continuous and strongly measurable and bounded as a 
function of t because the a nj ’s belong to W 1,00 (Q) and O is bounded and C°°. 

With the above definitions we see that the solution y in W(0, T; H, D') of 
the operational differential equation 


{A*(t))*y +^L= B(t)u , u € L\ 0, T; U), U = L 2 (r), 
2/(0) =y°eV' 


(2.42) 


coincides with the solution of problem (2.1). 

Similarly for the example of §2.2, the control functions are 

u = (ui,... ,un) £ L 2 (0,T;U), u = 'R n 

and the control operator is 


N 


(Bu,w)p = y ^Ujw(xj), w € D, u£ 


nJV 


(2.43) 


In other words 


N 


Bu{t) = y ^Uj(t)S Xi , 


i= 1 


where S Xi is the Dirac delta function in Xi. For domains O in R n , 1 < n < 3, the 
operator B: U —> D' is continuous and the operational differential equation 
(2.42) is a good model for point control. 

Notation 2.1. The operator (A*(t))* € C(H,D') is an extension of the opera¬ 
tor A(t) £ C(D, H) as defined in (1.5). In the sequel we shall write A(t) instead 
of (A*(t))* and keep in mind that A(t) € C(D, H) n C(V, V') ft C(H, D'). □ 


2.5 A change of variable 

It is a natural question to ask whether the operational differential equation 


A(t)y+^ = f £L 2 (0,T-D'), 


(2.44) 


2/(0) = y° £ V', y £ W(0,T; H, D') 

is fundamentally different from a variational differential equation of the form 


Mt)y + ^ = f £L 2 (o,T;V'), 

y(0) = y°£H, y£W(0,T;V,V') 


(2.45) 


of the type we studied in §1.3. 

It turns out that we can go from (2.44) to (2.45) by making the following 
change of variable: 



where 
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Hit) = [4 /2 (*)] _1 »W = A~ x 1/2 (t)y(t), (2.46) 

A\[t) = A(t) + A/ 


and A € K. is the number for which the V—H coercivity is verified. By Propo¬ 
sition 1.3, 

yeW(0,T;V,V'). 


Moreover 


But 


|=t 1/2 (4 + k i/2 ( ( ))V 


(A- l/2 {t))’ = -^ 1/2 (t)(4 /2 (t))X /2 W 

1 /2 

and the derivative of A x ( t ) makes sense as an element of C(H, V') and 
y £ L 2 (0,T] H) =► (A A 1/2 (t))'yGL 2 (0,T;P')- 

As for the first term 

A~ 1 / 2 {i)&C{D'y), 

^i 2 (0,T;fl') =► 4 A - 1/2 (^eL 2 (0,T;k'). 

Multiply the first equation (2.44) by A A 1 ^ 2 (t) 

A- l/ \t)A(t)y + A x 1/2 (t)^ = A~ 1/2 (t)f G L 2 (0,T; P'), 


Then 

and 

where 


d A 1/2 (0M0) = 4 1/2 (0) !/ o Gff. 

A- 1/2 (t)A(t) = A(t)A~ 1/2 (t) 


dy 


A{t)y(t) + ^ - (A A 1 / 2 (t))'A A / 2 (f)y = /, 


dt 


m = y °. 


/ = A a 1/2 (<)/ G L 2 (0, T; P), y u = A" i/z ((% u G H. 
The operator 

I<(t) = -(A A 1/2 (t))X /2 (t) = A; 1/2 (t)(4 /2 (t))' G £(V,if) 


-o _ A - i/2/ n \„,o 


(2.47) 


is a perturbation of the operator A(t), and we know from Theorem 1.2 that 
for such a perturbation, A + K is V-H coercive. 
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From this quick analysis we conclude that y given by (2.46) is the unique 
solution in PF(0,T; V, V') of (2.44) with 

A(t) = A(t)+A- 1/2 (t){A 1 x /2 (t)y. (2.48) 

To complete the picture, the control operators in the two examples of §2.1 
and §2.2 

B(t)eC(U,D') (2.49) 

are transformed into 

B[t) = A~ 1/2 (t)B(t) G C{U, V') (2.50) 

and we are back to variational differential equation (1.26). 

Thus the examples of §2, although quite different from those of §1, do 
not require a fundamentally new theory and appropriate changes in the state 
variable bring a significant simplification in the general analysis. 


2.6 Other isomorphisms 

Other isomorphisms can be used as starting points under the hypothesis 
dn 

ao, ~gf € L°°{Q), aij G 1 < i, j < n, 

and the coercivity hypothesis 

n n 

3a > 0, Yh a H 0*3 > a ^ G K”. 

i,j =1 i —1 

For instance the isomorphism 

DK^*(t)^,*| i;i{ )(r)j : H 2 ’ 1 (Q)->L 2 {Q)xH 3 / 2 ' 3 / 4 (E)xH\n), (C.R.) 

where C.R. stands for the “compatibility relations” among the three spaces, 
or 

V ~ (V(f)u - J£L,v(T)j : H 2 , 1 {Q) -> L 2 {Q) x H V 2 U\S) x H\n) 
(cf. A. Bensoussan and J. L. Lions [1, Chapter 2, §6]). 


3 Second order problems 

Second order problems are usually not variational and do not fall within the 
framework of this chapter. For example the wave equation 
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y" + A(t)y = f, 

2/(0) = 2/o, 2/(0) = 2/i 


(3.1) 


or Schrodinger’s equation are not variational. However in some cases when 
damping is added, some second order problems become variational. 

The simplest example 


I y” + 27 Ay' + Ay = f , 

\z/(o) = 2 / 0 , 2 /( 0 ) = 2 /i 

for 7 > 0 falls into this category. In fact (3.2) is known as the parabolic 
regularization of (3.1). J. L. Lions [4, Chapter 5, §1, p. 380] shows that 
as 7 goes to zero the solutions in (3.2) converge to the solutions of (3.1). In 
structure theory , (3.2) is often referred to as a structure with viscous damping. 
To see that (3.2) is variational we first rewrite (3.2) as a first order equation 
by introducing the new variables 

2 /° =y, y 1 = y' (3.3) 


and 


d_ 

dt 


y 


0 -1 
A 27 A 


y 


(3.4) 


Let V and H be two Hilbert spaces with continuous injection of V into H. So 
without loss of generality assume that 


M < v 


— 11 ^ 11, 


Vu € V. 


This defines a new operator 


A = 


0 

A 27 A 


(3.5) 


where A £ C(V, V') is generated by the bilinear continuous form on V 

(Av,w ) = a(v,w), (3.6) 


which is symmetrical, positive, and V-H coercive 

a(v,w) = a(w,v), a(v,v) > 0, (3-7) 

3a > 0, 3A £ R, a(v,v) + X\v\^j > a\\v\\y. (3.8) 

As we have two components we need two new spaces V and hi that will play 
the role of V and H. The space hi will be the product space V x H endowed 
with the inner product: For all v = (i> , id) and w = (w 0 ^ 1 ) 


fry w] = f a(v°, w°) + X(v°, vj°)h + ( v 1 ,vj 1 )h 


(3.9) 
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The space TL will be our new pivot space, and it remains to specify the space 
V. To do that we look at the continuity of the bilinear form 

a(v ,w) = [Av ,w]. (3.10) 

By construction 

a(v, w) = a(—v 1 ,w°) + X(-v\w°) + ( Av° + 2-yAv 1 ,w 1 ) (3.11) 

= — a{v x , w°) — A(u 1 , u>°) + a(v°, w 1 ) + 2 7 a(u 1 , w 1 ). (3-12) 

It is clearly continuous on V x V for V = V x V. Moreover, 

a(v,v) = —X (v 1 ^ 0 ) + 2'ya(v 1 ,v 1 ) (3.13) 

and 

~a(v,~v) + n\v, ~v] = —X^jV 0 ) + 2'ya(v 1 , v 1 ) + /i[a(z)°, u°) 

+ A|u°| 2 + |u 1 | 2 ] 

= 2 1 [a(v 1 ,v 1 ) + X\v 1 \ 2 }+n[a(v 0 ,v 0 ) + A|u°| 2 ] 

+ [ M -2 7 A]|u 1 | 2 -A(u 1 ,u°) 
>a[27||u 1 ||y+/i||u 0 ||y] + (/i —2 7 A)|u 1 | 2 —A(u 1 ,u°) 
> 7 a[lk 1 Hv + lk°llv] 


for fi > max{2 7 A , 7 + A 2 (4 7 a 2 )}. Thus a is V — Tt coercive and all the results 
of the previous sections apply. 

Another example that is of special interest is the so-called “structural 
damping,” which is of the form 


v" + 2 1 A l /y + Ay = /, 
1 /( 0 ) = 2 /o, 2 /( 0 ) = 2 / 1 ) 


and more generally for 0 < a < 1 


y" + 2 7 AV + Ay = /, 

2 /( 0 ) = 2 / 0 , 2 /( 0 ) = 2/1 - 


(3.15) 


(3.16) 


It is known (cf. S. Chen and R. Triggiani [1, 2, 3]), that for 1/2 < a < 1, 
the corresponding semigroup is analytic, but it is not yet known whether the 
problem is variational for 1/2 < a < 1 . 
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3 


Semigroup Methods for Systems With 
Unbounded Control and Observation 
Operators 


1 Complements on semigroups 

Let {S(t)} be a strongly continuous semigroup on the Hilbert space H. Let | • | 
and (•, •) be the norm and inner product in H. Denote by A the infinitesimal 
generator of {5(f)} and by D{A ) its domain. When D{A) is endowed with 
the graph norm of A 


\\h\\ 2 A = \h\ 2 + \Ah\ 2 , h G D(A), (1.1) 

it becomes a Hilbert space and 


A: D(A —> H 


( 1 . 2 ) 


is a continuous linear operator. 

1.1 Notation 

Let X and Y be two Hilbert spaces such that X C Y. In that case the 
interpolation spaces (X, Y)g tP with p = 2 and [X, Y]g coincide for 0 < 9 < 1 
(cf. Chapter 1, §4.7). We shall use the notation [X, 9, 0 < 9 < 1. 

For all data of the form 

y° G D(A), /eI 2 (0,T;fi(4)), (1.3) 

the function ^ 

y(t) = S(t)y° + [ S(t — s)f(s) ds (1.4) 

Jo 

is the unique solution in the space 

V(0 ,T;D(A),H) = jy e C([0, T];D(A)): ^ G L 2 (0,T;7L)| (1.5) 
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of the differential equation 


dy 

dt 


Ay + /, 


y(0) = y°. 


( 1 . 6 ) 


The notation in (1.5) will be used on several occasions. Given two Banach 
spaces with a continuous linear injection of X into Y, 

V(0,T;X,y) = |yeC([0,T];X): ^ GL 2 (0,T;F)J, (1.7) 

where dy/dt is to be interpreted as the vectorial distributional derivative of y 
in C([0, T\\X) considered as an element of L 2 (0,T;Y). 

It is well known that, by density of D{A) in H, the variation of constants 
formula (1.4) makes sense for data 

y°GH, feL 2 (0,T-H), (1.8) 


and such a solution is usually referred to as a “mild solution” of system ( 1 . 6 ) 
(cf. Chapter 1, Definition 3.1 (iv)). It is useful to be more explicit and precise 
about this. We first identify the elements of the dual H' of H with those of 
H, 

H= H'. 

Let {5*(f)} be the adjoint semigroup on H' = H and let A* be its infinitesi¬ 
mal generator with domain D(A*). When D(A*) is endowed with the graph 
norm of A*, the restriction of {S'*)!)} to D(A*) is also a strongly continuous 
semigroup on D(A*) 

S*(t) G C(D(A*),D(A*]). (1.9) 

For simplicity we still denote by {S*(f)} the semigroup on D(A*). Its topo¬ 
logical transposed 

S*(t)* G C(D(A*Y, D(A*)') (1.10) 

is also a strongly continuous semigroup on D(A*y. It can be viewed as an 
extension to D(A*)’ of the semigroup {S')!)} on H. For this reason we shall 
use the same notation {S(f)} and keep in mind that it can be viewed as a 
strongly continuous semigroup on either one of the three spaces 

D{A) -» H = H’ -► D{A*)'. (1.11) 


For data as specified in (1.8), let y in C([0, T]; if) be the function given 
by the variation of constants formula (1.4). For an arbitrary k in D{A*) 

(k,y(t)) = (S*(t)k,y°) + [ (S*(t - s)k, f(s)) ds. 

Jo 


This function is differentiable because for all k in ^(^4*) and s G [0,T[ 
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f)C* 

1 1 —► -^-(f — s)k = A*S*(t — s)k = S*(t — s)A*k 

belongs to C([s, T];H). To see that we compute the distributional derivative: 
For all ip € X>(]0, T[) consider the expression 


T = Io 


We can assume that — 0. For the second term 


r = — 


Jo dt Jo ds ^ s *^~ 

Jo dS Js dt ^ S *^ ~ S ) fc ’/( S ))^( t ) 

/ ds J s dt {Jt s *^~ + / 

J dt (^ A * k ’J S(t-s)f(s)dsj + (k,f(t)) 


<p(t). 


As a result 


^( k >y(t)) = (S*(t)A*k,y°) + J (S*(t-s)A*k,f(s))ds +(k,f(t)) 

= (• A*k,y(t )) + (, k,f(t )) 

and 

( dt = ^ y + (1.12) 

h(°)= ^ 0 ’ 

where 

(A*)*: H —> D(A*)' (1.13) 

is the transposed of the continuous linear operator 

A*: D(A*) —> H, (1.14) 

when D(A*) is endowed with the graph norm of A*. As for the semigroup 
{S(£)|, (A*)* is to be viewed as an extension of the operator A because they 
coincide on D(A). So we adopt the notation 

AeC(D(A),H)nC(H,D(A*Y) (1.15) 

in both cases and conclude that for data given by (1.8) the function y given by 
(1.4) is the unique solution in V(0 ,T;H,D(A*)') to the differential equation 
(1.6) (cf. Chapter 1, Remarks 3.1 and 3.2). 
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It is always possible to interpolate pairwise between the various spaces for 
A and S(t ) 

A G C([D(A), H} a , [D(A*), H}[_ a ), 0 < a < 1, (1.16) 

S{t) G £{[D(A),D(A*)']/3, [D(A), D(A*)%), 0 < /? < 1. (1.17) 

For some types of boundary control problems, it is necessary to also make 
sense of the solution of the differential equation (1.6) for data 

y° G D{A*)', f G L 2 (0,T;D(A*)'). (1.18) 

The starting point is again the variation of constants formula 

y{t) = S(t)y° + [ S(t — s)f(s) ds, (1.19) 

Jo 

where {S(£)| is now considered as a semigroup on D(A*)' rather than H. 

By definition y belongs to C([0, T]; D{A*)')- We can now repeat the previ¬ 
ous construction with k in D(A * 2 ), the domain of A* 2 , which coincides with 
the domain of the infinitesimal generator A* of {5*(£)} considered as a semi¬ 
group on D{A*) 

D(A*;D(A*)) = D{A* 2 -H) = D(A* 2 ), (1.20) 

where D(L;X) denotes the domain of the unbounded linear operator L con¬ 
sidered as an operator on the space X. 

The end result is that for data of the form (1.18), the function y given 
by expression (1.19) belongs to V(0, T; D(A*)', D(A* 2 )') and is the unique 
solution of the differential equation (1.6). The following theorem is the analog 
of Proposition 3.3 in Chapter 1. 

Theorem 1.1. Let {£(£)} be a strongly continuous semigroup and let A G R 
be such that 

A\ = A — XI € £(D(A), H) (1.21) 

be an isomorphism. The solution y of (1.6) for y° G H and f Gl7 1 (0,T; D(A*)') 
belongs to C' 1 ([0, T]; D(A*)') fl C([0, T]; H) and for all t, 0 < t < T, 

y(t) = -Ai 1 f(t)+S(t)[y° + Af 1 f( 0)] 

+ ^ S(t-s)Af 1 ^-(s)-Xf(s) ds. (1.22) 

Proof The solution y of (1.6) belongs to C([0, T\; D(A*)') and is given by the 
usual formula ^ 

y(t) = S(t)y° + f S(t-s)f{s)ds. 

Jo 
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We already know that for y° G H, the first term belongs to C([0,T];H) 
nC 1 ([0, T]\D{A*)'). So we only need to prove the theorem for y° = 0. Recall 
that g C(D(A), H) <1 C(H, D(A*Y). Hence 

y(t)= [ A x S(t~s)Ay 1 f{s)ds. (1.23) 

Jo 


But 

—— S(t — s) = AS(t — s) 
as 

and 


y(t) = ~l S{t-s)A x 1 \f(s)ds-J s)]A x 1 f(s)ds, 

y(t) = -A^f(t) + S(t)A^f( 0) + f S(t - s)A- 1 [f'( S ) - A f(s)] ds. 

Jo 

By assumption / G ff 1 (0, T; D(A*)') implies that 

A^f GH\0,T-,H)cC([0,T]-H) 

and necessarily each term and, a fortiori y. belongs to C([0, T]; H). Moreover 
^ t =Ay + feC{[Q,T}-D{A*)’) 

and 


y€C([0,T\;H)nC\[0,nD(A*y). 

This completes the proof. □ 

Remark 1.1. Notice that we also recover from identity (1-22) the usual results 
y° G D(A), fGH\0,T-H) =► y(=V(0,T-,D(A),H). 


□ 

Remark 1.2. For rough data identity (1.23) will often be used with the A\ 
outside the integral 

y(t) = S(t)y° + A x [ S(t — s)Ay 1 f(s) ds (1.24) 

Jo 

in order to take full advantage of the eventual smoothing properties of the 
integral. □ 

This technique readily extends to higher derivatives of the function /. 
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Corollary 1.1. Assume that, in addition to the assumptions of Theorem 1.1, 
y° £ D(A) and f £ C([0, T\; H) fl H 2 (0, T; D{A*)'). The solution y of (1.6) 
belongs to C' 1 ([0, T]\ H) fl C([0, T\-, D(A)) and for t, 0 < t < T, 

y (t) = ~Af 1 [f(t)+Af 1 (f\t)-Xf(t))]+S(t)[y° + Af 1 f(0)+Af 2 (f / (0)-Xf(0))] 

+ [ S(t - s)Af{f(s) - 2A/'(s) + A 2 /(s)] ds. (1.25) 
Jo 

Proof. It is convenient to introduce the following change of variable: 
y\(t) = e~ xt y{t), f x (t) = e~ xt f{t), S\(t) = e~ xt S{t). 

Then ^ 

V\(t) = S\(t)y° + [ Sx(t - s)fx(s) ds 

Jo 

and as in the proof of the theorem 

V\(t) = S\(t)y° + I A x Sx(t - s)Af 1 fx(s) ds 

Jo 

= Sx{t)[y° + A" 1 / a (0 )]- A^fxit) + [ S x (t — s)Af 1 f x (s) ds. 

Jo 

Now the same construction is used for the integral term 

r AxSx(t - s)Aff x (s) ds = f Sx(t - s)A x 2 f"(s) ds 

+sx{t)A~x 2 m-A- x 2 m. 

Finally 

yx(t) = -A~ x \f{i) + A~ x l f x (t)\ + S\(t)[y° + A?f x ( 0) + A~ x 2 f x m 

+ [ Sx{t — s)A x 2 f x (s) ds. 

Jo 

From the last identity it is easy to conclude that y has the expected regularity 
and that expression (1.25) can be easily recovered by a change of variable. □ 
The above statements are quite general. Sharper results are available for 
specific classes of systems such as analytic semigroups. 


2 Complements on analytic semigroups 

In this section we recall the main regularity result for analytic semigroups. 
With the help of interpolation theory we also give intermediary regularity 
results. Finally we show how the basic regularity result for analytic semigroups 
is at the origin of various methods of change of variable. 
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2.1 Regularity results 

Given a semigroup {S(t)} of type wq(S), for each u> > loo(S), there exists 
M > 1 such that 

\S{t)h\<Me ut \h\, VheH, Vf > 0. (2.1) 

The semigroup 

S u {t)=e~ ut S(t) (2.2) 

is a stable semigroup with infinitesimal generator 

A w = A — col: D(A) —> H (2.3) 

(cf. Chapter 1, Corollary to Theorem 2.2). Similarly for the adjoint semigroup 
{S*(t)}, the associated infinitesimal generator 

A*= A* -ul: D(A*) -> H (2.4) 

is also an isomorphism. Therefore the transposed of T* 

(T*)* : H —> D{A*)' (2.5) 

is again an isomorphism that can be viewed as an extension of A u from D{A) 
to H because they coincide on D(A) and D(A) is dense in H. Hence 

A u e C(D(A),H)uC(H,D{A*)') (2.6) 

and from Interpolation Theory for all a, 0 < a < 1, the map 

K : [D(A),H] a [D(A*), H][_ a (2.7) 

is also an isomorphism. 

Recall the following regularity theorem (cf. Chapter 1, §3, Theorem 3.1). 

Theorem 2.1. Let {£(£)} be an analytic strongly continuous semigroup. Then 
for all T > 0 the linear map 

y ^ Vy ={jf t - A y> y(°)) ; T ; D ( A )> H ) 

^L\0,T;H)x [D(A), H} 1/2 (2.8) 

is an isomorphism. 

Corollary 2.1. Let {S(t)} be an analytic strongly continuous semigroup. 
Then for all T > 0 the linear map 

y ^Vy= - Ay,y( 0)^ 

: W( 0, T; H, D{A*)') -» L 2 { 0, T; D{A*)') x [D(A*), H]' 1/2 (2.9) 

is an isomorphism. 
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Proof. The map (2.9) is clearly linear and continuous. To show that it is 
bijective, it is sufficient to show that for all 

/ £ L 2 (0,T; D(A*)') and y° £ [D(A*), H}' 1/2 , 
there exists a unique solution y £ W(0,T;H,D(A*)') such that 

y' — Ay = f, y(0) = y°. (2.10) 

Define for u> verifying (2.1) 

F = AZ 1 f£L 2 (0 1 T;H ) and F° = Af l y° £ [D(A), H\ 1/2 . 

By the previous theorem, the equation 

Y’ — AY = F, y(0) = Y° (2.11) 

has a unique solution Y £ W(0,T; D(A), H). Now define 

y(t) = AJY(t), t £ [0,T], 


It is easy to check that 


y = A^Y £ L 2 ( 0, T; H), y’ = A^Y' £ L 2 ( 0, T; D(A*)'), 

y(o) = a u y(o) £ [d(a*),h)' 1/2 . 


( 2 . 12 ) 


Therefore y £ IT(0, T; H , D{A*)') and 

y'-Ay = A u \Y' - AY] = A U F = f, y(0) = A u Y(0) = A U Y° = y°. (2.13) 


This completes the proof. □ 

We can now interpolate between isomorphisms (2.8) and (2.9). 

Theorem 2.2. Let {£(£)} be an analytic strongly continuous semigroup. Then 
for all T > 0, all a, 0 < a < 1, the linear map 

f y ^ Vy = - Ay, y(0)j 

} W{0, T ; [D(A), H] a , [D(A*), H]' x _ J (2 ’ 14) 

{ L 2 ( 0, T; [D(A*), H][_ a ) x [[D(A),H] a , [D{A *), H][_ J 1/2 

is an isomorphism. 

If we make the additional hypothesis 


[D(A),H] 1/2 = [D(A*),H] 1/2 (2.15) 

and denote this space by V, then, for a = 1/2, T> is an isomorphism 
W(0, T; V, V') -> L 2 (0, T; V) x H 


(2.16) 
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because [ V ., F']i /2 = H. This is to be compared with Theorem 1.1 in Chapter 2. 

There is virtually no limit to the up and down interpolation process be¬ 
cause for any integer n > 1 

: D(A n ) -► D(A" _1 ), A*” : D(A* n ) -> Z^A” 1 " 1 ) (2.17) 

are also isomorphisms. So the map 

V: W(0,T- D(A* n Y, D{A*^ n+1 ' , y) 

-» Z^T^A*^ 1 ))') x [D{A* n y,D{A* ( ' n+1 ' , ) , } 1/2 

is also an isomorphism and this can be combined with the results of Theo¬ 
rem 2.2 to obtain a continuum of isomorphisms. Define for r = n + a, n > 0 
an integer and a, 0 < a < 1 a real number, 

H r = [D{A n+1 ),D{A n )] 1 _ a , H~ r = [D(A*( n+1) ), D{A* n )\\_ a . (2.18) 

Then for all r in R, the map 

V : W(0,T-H r ,H r ~ 1 ) -> L 2 (y),T]H r ~ l ) x [H r , iZ r_1 ] 1/2 (2.19) 

is an isomorphism. 

2.2 Other representations and the method of change of variable 

It is well known that some non-homogeneous boundary value problems can be 
transformed into simpler homogeneous boundary value problems by an appro¬ 
priate change of the unknown or state variable y (cf. F. Treves [1, pp. 426- 
428]). This technique also finds its analog in Control Theory in the semigroup 
setting (cf. H. O. Fattorini [3], A. V. Balakrishnan [3], D. C. Wash¬ 
burn [1], J. Zabczyk [4], and A. Chojnowska-Michalik [1]). Specific 
examples will be given in appropriate chapters. 

For analytic semigroups, the regularity property of the map 

S: L 2 (0,T-D(A*)')^W(0,T-H,D(A*y), {Sf){t) = f S(t-s)f(s)ds 

Jo 

can be used to exhibit the underlying mechanism behind these methods. 

Theorem 2.3. Assume that {^(t)} is an analytic strongly continuous semi¬ 
group and that A G R is such that 

A\ = A — XI G C(D{A), H) (2.20) 

is an isomorphism. ForT > 0, / in L 2 (0, T; D(A*)') and h in [D(A*), H]y 2 , 
let 

y(t) = S{t)h+(Sf)(t) 

be the solution of (2.10) in W(0, T; H, D{A*)') 


( 2 . 21 ) 
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(i) The solution y is equivalently given by the expression 

y(t) = S(t)h + A f S(t- s)f\(s)ds - X f S(t - s)fx(s) ds, 
Jo Jo 


where 

h(t) = A~ 1 f(t), 0 <t<T. 

(ii) If, in addition, f G W(0,T; H, D(A*)')> then 

y (t) =Y(t)~ f x (t), 

where Y in W(0,T; H, D(A*)') is given by the expression 
f Y(t) = S(t)Y( 0) + J* S(t - s)^(s) ds, 

\y(o) = h + f x (o). 


( 2 . 22 ) 

(2.23) 

(2.24) 


(2.25) 


The proof is obvious and only uses integration by parts and the previous 
theorems. 

This theory directly applies to parabolic systems with control through a 
boundary condition (cf. §4). 


3 Unbounded control and observation operators 


The space of controls will be a real Hilbert space U and the space of control 
functions will be L 2 (0,T;U ) for some T > 0. The control operator is an 
element 


B € C(U, D(A*Y), 


(3.1) 


where D(A*) is endowed with the graph norm of A*. We say that B is bounded 
if 


B € C(U,H). 


(3.2) 


This terminology can be justified as follows. Consider the operator 


B* G C(D(A*),U'), \/u e 17, Vw G D{A*), ( B*v,u) v = {Bu,v) D(A , y (3.3) 


It is readily seen that B is “bounded” in the sense of our definition if B* is 
bounded as an operator from H' into U' 


B* G C{H’,U'). 


(3.4) 


We have seen in the chapters on parabolic systems and delay systems in Part I 
how this control structure naturally arises. 

The space of observations will be a real Hilbert space Z, and the space 
of observation functions will be L 2 (f),T] Z) for some T > 0. The observation 
operator is an element 
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CGJT(D(A),Z), 


(3.5) 


where D(A) is endowed with the graph norm of A. We say that C is bounded 
if 


C G £(H, Z). 


(3.6) 


The operator C* is the transposed of C 


C * G C(Z', D(A)'). 


(3.7) 


3.1 Analytic systems 

The system 

|S = ' 4!, + / ' t>0 - (3.8) 

[y( 0 ) = y° 

will be referred to as an analytic system if the operator A is the infinitesimal 
generator of an analytic strongly continuous semigroup {<?(£)}. We have seen 
in §2 that we have a strong regularity theorem for this class of systems (cf. 
Theorem 2.2 and the discussion thereafter). For all a, 0 < a < 1, the linear 
map 

5: L 2 (0, T; [D(A*), H][_ a ) W{ 0, T; [-D(A), H] a , [D(A*), H][_ a ) (3.9) 

is continuous. If we choose for some a, 0 < a < 1, 

B* G C([D(A*), H]i_ a ,U'), C e£([D(A),H] a ,Z), (3.10) 

then the linear map 

CSB: L 2 (0,T; U) —> L 2 (0,T; Z) (3.11) 

is continuous. As a result the system makes sense as an input-output system. 
To get a complete picture we can add the initial condition or state at time 

0 


h, u » CS(-)h + CSBu : [[D(A), H] a , [D(A*), !!}[_„] 1/2 

x L 2 {0,T-,U) -> L 2 (0,T;Z). (3.12) 

This model deals with an observation in the L 2 (0, T ; Z) sense. Other types of 
observations can be contemplated, but the philosophy is always the same: to 
make sense of the input-output map in appropriate function spaces. 

Notice that when identity (2.15) in §2 is verified the above discussion 
amounts to choose 

BeC(U,V'), Ce£(V,Z) (3.13) 

and the continuous linear map 


CS{-)h + CSBu 
: H x L 2 (0, T ; U) L 2 (0,T; Z). 


(3.14) 
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3.2 Unbounded control operators 

In §1 we made sense of the system 

dy 


dt= A>+Bu ' 

2 /( 0 ) = y° 


for the control and control functions 


(3.15) 


B e C(U,D(A*Y), u£ L 2 {0,T;U), y° £ D(A*)'. (3.16) 

From that analysis the linear map 

SB : L 2 (0, T ; U) -> V(0, T; D{A*)’, D{A* 2 )') C U([0, T]\D{A*)') (3.17) 

is continuous. We have seen in §3.1 that for analytic systems, the above map 
is continuous with values in W(0,T; H, D(A*)') and 

SB: L 2 (0,T-,U) -> L 2 {0,T;H). (3.18) 

For other families of semigroups such as systems with delays, we typically 
have 

B* : [D{A*),H\i/ 2 - e —> U' continuous Ve > 0 (3.19) 

and the continuity of the linear map 

SB: L 2 (0,T;U) -> C([0,T};H). (3.20) 

There are different ways to formulate hypothesis (3.20). We choose to 
formulate it in a “dual way” and then show it is equivalent to (3.20). 

Hypothesis 3.1. Given T > 0, the linear map 

h I—> B*S*(-)h: D(A*) -> C([0,T]-,U') (3.21) 

can be extended to a continuous linear map 

h B*S*(-): H —> I/ 2 (0, T; U'), (3.22) 

where B* is given by (3.3). □ 

Proposition 3.1. The following statements are equivalent: 

(i) Hypothesis (3.1). 

(ii) The linear map 

u ( SBu){T): L 2 { 0, T; U) -> H 


is continuous. 


(3.23) 
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(iii) The linear map 


u ^ ( SBu ): L 2 (0, T ; JJ) -» C{[0,T]-H) (3.24) 


is continuous. 

Proof, (iii) => (i) is trivial. 

(i) ==> (ii). For each u in A 2 (0,T; U), denote by u T the function 
u T (t) = u(T — t), 0 < t < T. 


For all h in D{A*) 


(B*S*(-)h,u T ) LH 0 , T . V) 



s)Bu(s) ds, h 


D(A *) 


= ((SBu)(T),h) D{A *y 


By Hypothesis 3.1 

\{(SBu)(T),h)\ < || J B*^(-)/t||L2(0.T;t/0lh T |l^(0.T;t/) 
< c\h\ ||u|||l 2( 0 T;(7 ) 


and necessarily 


(SBu)(T) G H, \(SBu)(T)\ < c\\u\\ L2{0tT . uy 

Therefore the map (3.23) is well defined and continuous. 

(ii) ==> (iii) Note that Hypothesis (3.1) for T implies that the same hy¬ 
pothesis is true for all t, 0 < t < T. As a result we can repeat the previous 
argument and obtain 

\((SBu)(t),h)\ < ||B*5*(-)/i||i2 (0)t; t// ) ||u||i,2 ( o )t; f7 ) 

< \\B* S* (’ )/^ll L 2 (0,T;t/ / ) II ^11 L 2 ( 0 , T ; U ) 

< c\h\ |M|.L 2 (0,T;t/)- 

Hence SBu is a well-defined function from [0,T] into H and 

sup |(S.Bu)(i)| < c||u|| L 2 (0jT;f/) . 

[0,T[ 

To prove the continuity of SBu for each u, define u G L 2 (0, oo; U) 


u(r) = 


Then for h in D(A*) 


u(r), r G [0,T], 
0, r >T. 
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(( SBu){t ), h) D(A ,) = f T {B* S*(T - s)h, [t(T - t)u](s)) ds, 

Jo 

where r(t) is the translation semigroup on L 2 (0,oo; U) 

[r(t)u](s) = u(t + s), t > 0, s > 0. 

So for any t' and t in [0, T] 

\{SBu)(t') - (SBu)(t), h > D (a *) I 

< || B*S*(T - •)^||l 2 (0,T;[/)||t(^ - t')u - t(T - t)u\\ L 2^ 0 T -U) 

< ||B*S'*(-)/i|| Z ,2 ( 0 T;! 7 )||t(T - t')u - t{T - t)tt|| L 2 (0,T;t/) 

< c\h\ || t(T - t')u - t(T - <)u||L 2 ( 0 ,oo;t/) 

\(SBu)(t')-(SBu)(t) I 

< c||r(T - t')u - t(T - t)u\\ L 2( 0 ,oo;U)- 

By strong continuity of the translation semigroup, we conclude that SBu is 
continuous and that (iii) is true. This completes the proof of Proposition 3.1. 

□ 


Theorem 3.1. Fix T > 0 and assume that Hypothesis (3.1) is verified. Then 
for data 

y° € H, u £ L 2 (0,T; U), (3.25) 

the function 

y(t) = S(t)y° + (SBu)(t) (3.26) 

is the unique solution in V(0 H, D(A*Y) to the differential equation 


f t = Av+Bu - 

y(o) =y°, 


(3.27) 


and there exists a constant c > 0 such that 


ll2/||c([0,T];ff) 


dy 

dt. 


L 2 (0,T;D(A*)') 


< c [1 2/° I H + |MU 2 (0,T;[/)]- (3.28) 


The above results are general and essentially require an hypothesis on the 
free adjoint system 

dV _ A* 

dt ’ (3.29) 

v(T) = he H, 


with observation operator B* 


z(t) = B*v(t ) 


(3.30) 
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because 

z(t) = B*S*(T — t)h. (3.31) 

When system (3.15) is time varying (that is, with A*(t) instead of A*) : Hy¬ 
pothesis 3.1 would require that the linear map 

/ih H -► L 2 (0,T;[/') (3.32) 


be continuous. 

We can also use the method of change of variable in Theorem 2.3 to trans¬ 
form expression (3.26) into 

y{t) = S(t)h + A x {SA^Bu)(t). (3.33) 

Define 

B x = A~ l B e C(U,H) (3.34) 

and introduce the change of variable 

Y(t) = y(t) + B\u(t), 0 <t<T. (3.35) 

Then we have the following equivalent representations: 

y(t) = S(t)h + A ( S(t — s)B\u(s) ds + ( S(t — s)[—\B\]u(s) ds, (3.36) 
Jo Jo 

y(t) = Y (t)- B x u{t), 

Y(t) = S(t)Y( 0)+ f S(t- s)Bx^-(s) ds 
< Jo t dS (3.37) 

+ / S(t — s)[— \B\]u(s) ds, 

\ Jo 

y(0) = h + B x u{0), «£ H\0,T\U). 

This is to be compared with Theorem 2.3. 

The next theorem relates expressions (3.26) and (3.36). 

Theorem 3.2. Assume that A is such that A x is an isomorphism. 

(i) The map 

u i—> SBu: L 2 (0,T-,U) -> C([0,T]-,H) (3.38) 

is continuous if and only if the map 

u i—> SB x u: L 2 {0,T;U) —► C([0,T]-D{A)) (3.39) 

is continuous. 

(ii) Hypothesis 3.1 is equivalent to the existence of the continuous linear ex¬ 
tension 

h^B* x S*(-)h: D(A)' -► L 2 {0,T;U') (3.40) 


to the map 


h i—> B x S*(-)h : H C([0,T};U'). 


(3.41) 



216 II-3 Semigroup Methods for Unbounded Control and Observation 

Proof. We use the fact that SBu = A\(SByu). □ 

It is always possible to make a change of variable to make sense of a control 
operator B € C(U,D(A*)'). For instance, by using the resolvent 

R(X,A) = [A I-A}- 1 , 

we have 

R(X, A)SB = SR(X, A)B. 

Define the new control operator 

B = R(X,A)B G C(U,H), 
y(t) = R{X,A)y(t) => y(t) = (SBu)(t). 

It is easy to check that Hypothesis 3.1 

h e-> B*S*(-)h: ff^L 2 (0,T; U’) 

is equivalent to 

h B*S*(-)h: D{A*) -> L 2 (0, T; U'), 

which is always verified! The price to pay for that change of variable is that 
the new state variable belongs to C([0, T]\D(A*)') rather than C([0,T]- H). 


3.3 Unbounded observation operators 

This section is “dual” to §3.2. We start with the free system 


y(t) = S(t)h, h G H, t > 0, 

(3.42) 

{ dy A 

\ 7 t= Av ' 

(3.43) 

II 


The observation equation is 


z(t) = Cy(t ), 0 < t < T. 

(3.44) 

From now on, everything we said for B* and {<S*(t)} in 

§3.2 is true for C and 

Hypothesis 3.2. Given T > 0, the linear map 


h h-> CS(-)h: D(A) C{[0,T]-Z) 

(3.45) 

can be extended to a continuous linear map 


h h-> CS(-)h: H ^ L 2 (0,T;Z). 

(3.46) 


□ 
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Define for S* the analog of S in (3.9) for S: 

S*: L 2 (0,T-,H) -+ L 2 (0,T;i?), (3.47) 

(S*g)(t)= f S*(t-s)g(s)ds. (3.48) 

Jo 

This operator is not to be confused with the topological dual ( S )* of 

5: L 2 (0,T;H) -> L 2 {0,T;H). (3.49) 

They are however related in the following way: 

[(5)* ff T ](t) = (5* 5 )(T-t), 0 < t < T, (3.50) 

where 

g T (t) = g(T-t), 0 <t <T. (3.51) 

Proposition 3.2. The following statements are equivalent: 

(i) Hypothesis 3.2. 

(ii) The linear map 

z i—> (S*C*z)(T): L 2 (0, T; Z') —> H (3.52) 

is continuous. 

(iii) The linear map 

z^S*C*z: L 2 (0,T;Z') -> C([0,T};H) (3.53) 

is continuous. 


Theorem 3.3. Fix T > 0 and assume that Hypothesis 3.2 is verified. Then 
for data 

w° G H, z € T 2 (0, T ; Z'), (3.54) 

the function 

w(t) = S*(t)w° + {S*C*z){t) (3.55) 

is the unique solution in V(0 ,T; H, D(A)') to the differential equation 

dw 

— _L ( '.* -y 

(3.56) 


= A*w + C*z, 


dt. 

w(t) = w°, 


and there exists a constant c > 0 such that 
I dw 


IMIcQO.TJjff) 


dt 


L 2 (0,T\D(A)') 


< c[\w | h + ||2||l2(o,t ; z')]- (3.57) 


Theorem 3.4. Assume that A € R is such that A\ is an isomorphism. 
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(i) The map 

z^S*C*z: L 2 (0,T;Z') -► C{[0,T];H) (3.58) 

is continuous if and only if the map 

z t—>■ S*C*fz : L 2 (0,T;Z') -► C([0,T\;D(A*)) (3.59) 

is continuous, where 

C\ = CAf 1 G £{H, Z). (3.60) 

(ii) Hypothesis 3.2 is equivalent to the existence of the continuous linear ex- 


tension 

h i—> C\S(-)h: D(A*)' 

—* L 2 (0, T ; Z) 

(3.61) 

to the map 

h i—> C\S(-)h: H-> 

C([0,T}-Z). 

(3.62) 


3.4 Unbounded control and observation operators 

When we consider the controlled system 

t = Av+ B “- 

.1/(0) =y°, 

with the observation 

z(t) = Cy(t), 

the natural hypothesis that comes is the following one. 
Hypothesis 3.3. The linear map 

CSB: L 2 (0,T; U ) -> L 2 (0,T; Z) 

is continuous. 

By duality, this is equivalent to the continuity of the map 

'B*S*C* : L 2 (0,T; Z') -> L 2 (0,T;[/'), 

rT 


= S(s-t)*g{s)ds. 


(3.63) 

(3.64) 

(3.65) 
□ 

(3.66) 


Unfortunately this last statement does not really provide additional infor¬ 
mation on the specific connections among C , A, and B to produce the map 
(3.65). 

In order to gain some insight into this problem we turn to the method 
of change of variable introduced in §2.3 (Theorem 2.3) and use it twice to 
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simultaneously handle the unboundedness of B and C (cf. also Theorem 1.1 
and its corollary). 

We proceed formally. The state y is given by the formula 

y(t) = S(t)h+ f S(t — s)Bu(s) ds. (3.67) 

Jo 

Let A G R be the number for which 

A a = -[XI-A]e C(D(A), H) n C(H, D(A*)') 
is an isomorphism. Define for all t > 0 

= e~ xt y{t), 

< u\(t) = e~ xt u{t), (3.68) 

(s x (t) = S(t)e~ xt . 

It is easy to check that {S' A (f)} is also a semigroup and that 

^-S x (t)h = A x S x (t)h, \/h G D(A). (3.69) 

at 

Equation (3.67) is equivalent to 


y x (t) = S x (t)h + [ S x (t - s)Bu x (s) ds (3.70) 

J o 

and the observation 

z x (t) = e~ xt z[t) = Cy x (t). (3.71) 

In order to remove the unboundedness of B G C(U, D(A*)') we proceed as 
in Theorem 1.1. Assume that 


u x e -ff 1 (0,T; U) 

and introduce the new operator B x and the new variable Y\ (t) 

(b x = a^ 1 b e C(U,H), 

\Y 1 (t) = y x (t) + B x u x (t)eL 2 (0,T;H). 

By performing integration by parts we get 

fri(t) = s , A (i)yi(o) + j s x (t-s)B x ^( s )ds, 
1 ^ 1 ( 0 ) =h + B x u x (0) £H, 


(3.72) 


(3.73) 


(3.74) 


and we conclude that (cf. Theorem 1.1) 
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Y\ G C([0, T]; i?) n C' 1 ([0, T]; D(A*)'). 

To remove the unboundedness of C G £(D(A), Z), we assume that 
u\ G H 2 (0, T ; U), h G D{A) and CA~f l B G C(U, Z) 
and introduce the new operator C\ and the new variable Y 2 (t) 

jc x = CA- 1 G £(H, Z), 

{ Y 2 (t) = A x Y 1 (t) + B x ^(t). 


(3.75) 


(3.76) 


(3.77) 


This situation is slightly different from the corollary to Theorem 1.1 because 
it cannot be a priori assumed that Bu(-) G C([0,T];H). So we assume that 
ua(0) = 0 in (3.74). By integration by parts we get 


[Y 2 (t) = S x (t)Y 2 ( 0) + [ S x (t - s )B x ^(s)ds, 

I Jo ds (3.78) 

[Y 2 (0)=A x h + B x ^(0). 

The observation equation is 


z x (t) = Cy x (t ) = ClY^t) - B x u x (t)} = CA^lAxY^t) - A x B x u x (t )] 


and 


Finally 


z X {t)=C x 


Y 2 (t)-B x ^(t) 


C x A x B x u x (t). 


z X (t) = C\Y 2 (t) - C x B x u x {t) - C x A x B x u x (t). 


(3.79) 


The second term belongs to i7 1 (0,T;Z) and the last term to H 2 (0,T- Z) 
because we have assumed that 


C X A X B X = CA-'B g C(U, Z ). (3.80) 


As for the first term 

C x Y 2 (t) = CS x (t)h + C x S x (t)Bu' x ( 0) + [ C x S x (t - s)B x u x (s) ds, 

Jo 

it is well defined for h G D(A) and all u x G H 2 (0,T ; U) such that u x (0) = 0. 
Finally Za € C([0,T];Z) for all h G D(A) and u G H 2 (0,T-,U) such that 
u(0) = 0. We summarize our conclusions in the next theorem. 

Theorem 3.5. Assume that X G R is such that A x be an isomorphism. If the 
compatibility relation 

CA~f l B G C(U, Z) (3.81) 

is verified, then the linear map 
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z:{u£ H 2 (0,T ; U): u(0) = 0} -> L 2 (0,T; Z) 
is continuous, where 

z(t) = e xt z x {t), u\(t) = e~ xt u(t), 

z\(t) = —C\A\B\ U \(t) + C\ J S x (t~s)B x ^(s)ds 

- C x B x u' x (t) + C x S x (t)B x u' x (0). 

Hypothesis 3.3 is verified if and only if the map (3.82) can be continuously 
extended to all L 2 (0,T;U). 

Remark 3.1. Hypothesis (3.82)-(3.84) is verified under the compatibility rela¬ 
tion (3.81). However, it is not clear whether Hypothesis (3.82)-(3.84) implies 
(3.81). □ 

When the control and observation operators are “more unbounded” 

B G C(U, D(A* n )')C G C(D(A m ), Z), CAf e B G C(U, Z), 

1 < t < to + n, (3.85) 

the previous constructions can be repeated. For the control operator we in¬ 
troduce the new variable 


(3.82) 

(3.83) 

(3.84) 


ra+l n 

Y n (t) = y x (t) + Y J A n x - {i+1) B x ^{t) 


i —0 


is continuous and the operator 

B x = Af n B G £(U, H). 
The new variable is given by the expression 


pt rl n ii 

Y n (t) = S x (t)Y n { 0 ) + J o S x (t - s)B x —j-^-(s) ds. 


Similarly on the observation side we define the new state variable 

m— 1 

\m-l-1 R, . 

dt n+l 


Y n+m (t) = A™Y n (t) + A r e ~ lB x^r(t) 


£=0 


and the operator 


C x = CAf m G C{H,Z). 


The new state is given by 


f l d n+m v\ 

Y n+m {t) = S x (t)Y n+m ( 0 ) + j S x (t - ds 


(3.86) 

(3.87) 

(3.88) 

(3.89) 

(3.90) 

(3.91) 
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and the observation by 


zx{t) = Cy x {i) = CA~ m A™y x (t) = C x A™y x (t ) 


(3.92) 


or 


m+n— 1 

z x (t) = C x Y n+m (t ) - ^ C \A 
£=0 


m+n— 1 —t ^ /,\ 


(3.93) 


Notice that in view of hypothesis (3.85) the terms in u x all make sense for 
h G D(A m ), u G H m+n (0,T-,U), and #(0) = 0, 0 < £ < m + n- 1, and that 
a statement similar to the one of Theorem 3.5 can be made. 


4 Time-invariant variational parabolic systems 

In this section we specialize the results of §1 and §2 in Chapter 2 of Part II 
to the time-invariant case, compare them with the ones that can be obtained 
by semigroup methods, and relate them to the semigroup model for control 
of §3. The starting points are Theorem 1.1 in §1.3 and Theorem 1.4 in §1.5 
(Chapter 2 of Part II). More precisely we start with a continuous linear op¬ 
erator 

4g£( V,V') (4.1) 

for which the V-H coerciveness hypothesis 

3a > 0, 3A G R, Vu G V, (Av, v)v + A|z;| 2 > a||w|| 2 (4.2) 

is verified. Theorem 1.1 says that, for all T > 0, the variational differential 
equation 

4j/+^ = /GL 2 (°,T ; U'), y(0)=y°GH (4.3) 

has a unique solution y in W(0,T;V,V') C C([0,T]; H). For / = 0 the solu¬ 

tions of the above equation generate a strongly continuous semigroup {S'(t)} 
on the Hilbert space H 

S(t)y° = y(t), t> 0, Vy° G H. (4.4) 

Its infinitesimal generator coincides with —A, the domain of which will be 

written D(A). We emphasize the fact that in other chapters on semigroup the 
infinitesimal generator is usually written A. The notation —A is exceptionally 
used to be consistent throughout this section. 

In §1 we have seen that the function 

y(t) = S(t)y° + f S(t — s)f(s) ds in D(—A*)' (4.5) 

Jo 

is also the solution of system (4.3) in V(0 ,T; D(—A*)', D(—A* 2 )'), which is a 
larger space. Theorem 1.1 contains the following regularity property: For all 
T > 0, the linear map 
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S:L 2 (0,T-V')^W(0,T-V,V'), (Sf){t) = f S(t - s)f(s) ds (4.6) 

Jo 

is continuous. 

From semigroup theory in Chapter 1 of Part II (cf. §2, Theorem 2.12), 
the semigroup {S(£)| generated by —A on the Hilbert space H is analytic. 
Moreover for the A of the coercivity assumption (4.2) the operator 

-A x = —A — XI (4.7) 

is the infinitesimal generator of the strongly continuous analytic contraction 
semigroup 

S x (t) = e~ Xt S(t), t > 0 (4.8) 

on H. As a consequence the linear map 

: L 2 { 0, T; H) -+ IT(0, T; D(-A),H) C C([0, T]; [D(-A),H\ 1/2 ), 

r* (4.9) 

{S\f){t)= S\(t — s)f(s) ds 

Jo 

is continuous and there exists a constant M > 0 independent of T > 0 such 
that 

II ~ A\S\f\\ L 2( 0 T .H) < M\\f\\ L 2(Q T . H y (4-10) 

But under assumption (4.2), — A\ is invertible and 

\\S\f\\w(0,T-,D(-A),H) < M'\\.f\\L 2 (0,T-H) (4-11) 

for some constant M' > 0 independent of T and /. From the above property 
and the identity 

(Sfm=e xt [S x (e- x -mt), (4.12) 

we can obtain for Sf an inequality similar to (4.10) but with a constant 
M(T, A) > 0, that now depends on T and A (monotonically increasing with 
A > 0): 

\\Sf\\w( 0 ,T-,D(-A),H) < M(T, \)\\f\\ L 2 ( 0 ,T-,H)- (4-13) 

This last identity shows that we have the regularity result 

5 : L 2 (0, T; H) -> IT(0, T; D(-A), H) (4.14) 

for the map (4.6). Now —A\ = —A — XI is an isomorphism from D(—A) onto 
H and from H onto D(—A*)'. It follows from the identity 

A-'Sf = SA- 1 / (4.15) 


that 


S: L 2 (0,T-,D(-A*)') -> W (0, T; H, D(—A*)') 


(4.16) 
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is also an isomorphism which can be regarded as an extension of (4.14). In 
particular for a, 0 < a < 1, 


5: L 2 (0,T-,[H,D(-A*)'] a ) 

W( 0, T; [D(-A), H] a , [H, D(-A*)'] a ) (4.17) 


is an isomorphism that can also be expressed in terms of the domains of the 
fractional powers A x of A\ (cf. Chapter 1, §6, Proposition 6.1) 

D{A%) = [D(-A),H] 1 - a = [D(A ), H^. (4.18) 

Finally 

5 : L 2 {0,T;D{A* x a y) W (0, T; D(A 1 x ~ a ), D(A* x a )') (4.19) 

and in particular for a = \ 

S : -b 2 (0, T ; D(A* X 12 )') -+ W(0, T; D(A\ /2 ), D(A* x 1/2 )'). (4.20) 

Comparing the above map to (4.6), we cannot conclude that they coincide. 
However if we assume that 

D(A{ /2 ) = [D(A), H} 1/ 2 = [D(A*), H] 1/2 = D(A* X 1/2 ), (4.21) 


then 

[D(A), H] 1/2 =V = [D(A*),H] 1/2 (4.22) 

and we recover (4.6) (cf. Chapter 2, Remark 1.2 and Theorem 1.3). It says 
that in the variational case (4.6) is generally true without assumption (4.22). 

For the control through a Neumann boundary condition, we have seen in 
§1.2 (Chapter 2, Part II) that the control operator B is of the form 


(Bu,v)v = J uv\ r dr, u£L 2 (r), vGV, 


(4.23) 


where 


H = L 2 (n), V = H\fl), D(A*) = (d? H 2 (Q): =ol, 

i. p J 


D(A) = {veH 2 (n): 


dv 

dv\ 


= 0 ^. 


(4.24) 


Here the hypotheses of Theorem 1.3 (Chapter 2 in Part II) are verified with 
X = ff 2 (ff) and 

D{A l/2 ) = D(A* 1/2 ) = V. (4.25) 

Notice also that not only B e £(£/, V') but also 

b e c(pH^ 2+2£ (ny), £>o 


(4.26) 
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because the trace operator 

v^v\ r : tf 1/2+2£ (H) -> U = L 2 (r) (4.27) 

is continuous. Moreover 

H 1 / 2 + 2 e (Q) = [D{A*), H} 3/ 4 _ e = D(A* (1/4+£) ) (4.28) 

and 

B G C{U, £>(A* (1/4+£) ) / ). (4.29) 

For the control through a Dirichlet boundary condition, we have shown in 
§2.1 (Chapter 2 in Part II) that the control operator B is 

r 

( Bu,v) D ( A *)= / dr, u G L 2 {r), V G D{A*), (4.30) 

Jr c/ua* p 

where 


H = L 2 (Q), V = D(—A) = D(—A*) = H 2 (n) n (4.31) 

which necessarily implies (4.23). Here the trace operator 

v - - : H 3/2+2e (n) D Hq(Q) -► L 2 {r), e > 0 (4.32) 

OVA* p 

is continuous, 

H 3/2+2e (0,) n H 3 (fl) = [D(A*), H\ i/4_ e = D(H* (3/4+£) ), (4.33) 

and 

B G C(U, £>(H* (3/4+£) )'), u = L 2 {r). (4.34) 

In both cases hypothesis (4.22) is verified and 

SB : L 2 (0, T ; U) -> W(0,T; H, D(A*)') C L 2 {0,T;H). (4.35) 

Sharper results can also be obtained in view of (4.27) and (4.32): For Neumann 
SB: L 2 (0,T-,U) -* W(0,T;D{A 3 / 4 - £ ),D(A^ 1 / i+£ '>Y), (4.36) 

and for Dirichlet 

SB: L 2 (0, T; U) -> IF(0, T; D(H 1/4 “ £ ), D(H* (3/4+£) )'). (4.37) 

In §2 we have shown that under Hypothesis 3.1 the map 

SB: L 2 (0,T;U) -> C{[0,T];H) (4.38) 


is continuous. Hypothesis 3.1 amounts to prove that the map 
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h B* S*(-)h: -^L 2 (0,T; U') 

or, equivalently, that the map 

h e-> B*v: H —> L 2 (0,T;L 2 (r)) = L 2 {E) 
is continuous for v the solution of the adjoint system 

dv 

A* v + — = 0 on]0,T[, v(T) = h. 
dt 


For the Neumann case 


and 


O 

A*v + = 0 in Q, 

at 

dv 

- -= 0 on E, 

ov A * 

v(T) = h in fl, 


B*v = v\ s . 


Here for h in H, v G W( 0, T; V, V') C L 2 (0, T; V) and 

i 2 (0, T; H\V)) -> L 2 (0, T; L 2 {r)) = L 2 {E) 

is linear and continuous. Therefore, Hypothesis 3.1 is verified. 
For the Dirichlet case 

O 

A*v + = 0 in Q, 

at 

v = 0 on E, 
v(T) = h in 0, 


and 


For h in U, the map 


B*v = 


dv 


dv A • 


dv 


dv A * 


: W(0,T- 1 D(A*),H) -> H 1/2 ’ 1/4 {E) 


is continuous, but for all h in H , 


G H 1/2 ’ 1/4 {E) and 


dv 


dv A * 


?L 2 (E). 


(4.39) 

(4.40) 

(4.41) 

(4.42) 

(4.43) 

(4.44) 

(4.45) 

(4.46) 

(4.47) 

(4.48) 


From this Hypothesis 3.1 fails and we would conclude that the elegant 
framework of this chapter is not adequate for parabolic systems with control 
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through a Dirichlet boundary condition. However if we first perform the change 
of variable of §2.5 (Chapter 2 in Part II) 

V{t) = A-^yit), v(t) = A 1 / 2 v(t), (4.49) 


then 


dy_ 

dt. 


-Ay + Bu , B = A~ 1 ^ 2 B g C(U, V'), 
y(0) = A-Wyi 0) G H, 


(4.50) 


and 


dv 

dt 


—Av, 


v{T) = A 1 / 2 v(T) G H 


v{T) =heV. 


(4.51) 


Thus in view of (4.45), Hypothesis (3.1) is verified and the framework of 
this chapter is now appropriate for a parabolic system with control tfo'ough a 
Dirichlet boundary condition. In addition, 


ye 


L 2 (0, T ; V) => r 1/2 j/Gl 2 (0,T;h) =4- y G L 2 (0, T; H), (4.52) 


but we only have 


V G C([0, T]; V'). 

In fact we do not need the full force of A~ x ! 2 and H -1 / 4+£ is sufficient 
B G C(U, D(A*AA+Ay) an d 


(4.53) 

because 


B = A~ l / A+e B G C(U, D(A* 1 ^ 2 )') = C(U, V ') 


because 


H*(I/ 4 — £ ) g £(D(H* 1/2 ),£»(H* (1/4+£) )). 




4 


State Space Theory of Differential Systems 
With Delays 


1 Introduction 

In this chapter our objective is to present a modern approach that provides 
a unifying framework for a large family of differential and integro-differential 
systems with delays. This point of view is of paramount importance for the 
Control Theory, Filtering Theory, and Realization Theory of such systems. 
The material presented in this chapter is an outgrowth of the lecture notes 
in French presented at the INRIA School on Representation and Control of 
Delay Systems in June 1984 by M. C. Delfour [14]. The original material 
has been restructured, the proofs have been streamlined, and new results have 
been introduced in §6. 

According to A.D. Myshkis [1], the origin of differential equations with 
delays or “differential equations with a retarded argument” goes back to Con- 
DORCET in a “Memoire de l’Academie des Sciences” dated 1771 about a prob¬ 
lem studied by Euler in 1740. So it is a topic with a relatively long history. 

To appreciate the specificity of a delay differential equation, recall that 
ordinary differential equations are essentially local (in time) relations of the 
form 

F(t, x(t), x (1) (t), x (2) (t), ..., x {n) (t)) =0 (1.1) 

between the function x and its derivatives x^\ 1 < i < n. Equation (1.1) 
relates x and its derivatives at time t. However other types of relations F can 
be constructed that relate x and its derivatives at different times. For instance 

x^\t) — x(t — 1) = 0 or x^(t) — x(|) = 0. (1.2) 

Such relations belong to the general class of “Functional Differential Equa¬ 
tions or Differential Equations with a Deviating Argument (in papers from 
U.R.S.S.).” They essentially define a functional relation G between the func¬ 
tion x and its derivative, 


G(:r,x (1) ,...,a; (n) ) = 0, 


(1.3) 
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as opposed to the local relation F in (1.1) at time t. At that level of generality 
everything is possible and the variable x need not be interpreted as a function 
of time. However it is customary to call the variable t the time and we shall 
follow this convention. 

Functional Differential Equations (FDEs) have often been classified into 
three categories: retarded type as in (1.2) advanced type 

x ^ (■ t ) = x(t + 2) (1.4) 

or neutral type 

x ^ (■ t ) = x^ (t — 1) + x(t — 1) + x(t). (1.5) 

In this chapter we shall take the down-to-earth point of view that a real 
system is nonanticipatory and limits our analysis to systems where the solution 
x(t'), t' > t, only depends on the past values x(s), s < t, of the variable x. 
This definition does not only cover differential equations with delays but also 
important classes of integral or difference equations as we shall see in §1.2. 
This broad family of systems will be referred to as Delay Systems or sometimes 
as Hereditary Systems. 

Such systems enter into the modelization of many problems: technolog¬ 
ical systems (e.g., chemical processes, rolling mills), the classical two-body 
problem in electrodynamics, the dynamics of nuclear reactors, the transmis¬ 
sion line model, population models, biomedical systems (e.g., control of the 
human respiratory system), the propagation of diseases in a population, the 
control of epidemics, economic systems, and even the famous macro-economic 
models “a la “ Forrester” (cf. M. C. Delfour and A. Manitius [1] for 
details and specific references). 

Detailed bibliographies on FDEs have been initiated by A.D. Myshkis [2] 
in 1949 and periodically updated by N. H. Choksy [1], The first books writ¬ 
ten in English were probably those of E. Pinney [1] in 1958, R. Bellman 
and K. L. Cooke [2] in 1959 and 1963, J. A. Nohel [1] in 1964, A. Ha- 
LANAY [1] in 1966, and the translations in 1966 of the 1964 book of Elsgolc 
and the one of A.D. Myshkis [2] in 1951. This topic has been widely stud¬ 
ied by numerous mathematicians and engineers everywhere in the world. We 
recommend the book of J. K. Hale [3] and its bibliography for a detailed 
treatment of delay systems up to 1977. Several references to the engineering 
literature have been included in our bibliography because problems in Con¬ 
trol Theory have often been the motivation behind the various state space 
formulations we shall encounter in this chapter. 

This chapter will emphasize the product space approach, which seems to 
have been independently introduced in the late sixties-early seventies by 
M. Artola [1, 2, 3] for parabolic partial differential equations with de¬ 
lays, M. C. Delfour and S. K. Mitter [2, 3, 4, 5, 9] for nonlinear 
time-varying delay differential equations, and by Ju. G. BORISOVIC and 
A. S. Turbabin [1] for nonhomogeneous linear time-invariant delay differ¬ 
ential equations. At that time our objective was to bring the theory of sys¬ 
tems with delays more in line with the modern theory of partial differential 
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equations in Hilbert spaces and build up a unified Control Theory of Infinite 
Dimensional Systems. In that regard delays systems were very appealing be¬ 
cause they were halfway between ordinary differential equations and partial 
differential equations. 


2 Examples and orientation 

2.1 Examples 

In this section we provide a series of simple examples to introduce and moti¬ 
vate the model and the constructions, which will be used in this chapter. 

Example 2.1. Delay differential equations. 

N 

y{t) = '^2y(i-i), t > 0, y(0) = 0(0), -N < 0 < 0, (2.1) 


2—0 


where IV > 0 is an integer. 

Example 2.2. Volterra integro-differential equations. 


y(t)=[ A(r - t)y(r) dr, t > 0, y(0) = 0°, 
Jo 


where A is an Z. 1 -function. 

Example 2.3. Integro-differential equations. 


/ U pO 

Ai(9)y(t + 6) dO + / A 2 {9)y{t + 9) d6, t > 0, 

-h J-h 

y(9) = 0(0), -h<9< 0, 


where A\ and A 2 are square integrable functions. 

Example 2.4. Functional differential equations of neutral type. 

x{t) = x(t — 1), t > 0, x(9) = 0(0), —1 < 0 < 0. 

Example 2.5. Volterra integral equations. 


;(t) = f A(s — t)x(s) ds + f(t), t > 0, 

Jo 


where A and / are locally integrable. 


□ 

( 2 . 2 ) 

□ 

(2.3) 

□ 

(2.4) 
□ 

(2.5) 
□ 
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Example 2.6. Difference equations. 


N 

x(t) = ^ Aix(t — i), t > 0, 

i 

x(0)=<l>(e), —N < 9 < 0, 


where N > 1 is an integer. 


( 2 . 6 ) 

□ 


Example 2.7. Delay-differential equations with delays in the trajectory, con¬ 
trol and observation variables. 


N 


y(t ) = -i) + u(t - *)], 


i=0 


^x(t) = C 0 y(t) + Ciy(t - N) + K 0 u(t ) + K\u{t - N), 


(2.7) 


where IV > 0 is an integer. □ 

The first observation is that in Examples 2.1, 2.9, and 2.10 (resp. 2.11, 2.12 
and 2.13), y(t) (resp. x(t)) is not a good candidate for the state at time t > 0. 
The intuitively natural one is 

Vt (resp. x t ) : I(—h, 0) —> K, 
yt(d) = y(t + 9) (resp . x t (0) = x(t + 6)), 

where h,0 < h < +oo is the length of the memory of the system and 

/(-/i,0)=«n[-/i,0|. (2.9) 

So in Examples 2.8 and 2.9, the differential equation is of the form 

y(t) = Hy t , t > 0, (2.10) 

for an appropriate real-valued map H defined on the space of real-valued 
continuous functions on I(—h, 0) or, as we shall see later, on some subspace 
in the case of infinite memory (h = + 00 ). 

Example 2.8. 

h = N, = i>0 ’ (2.11) 

Uo = 0. 

□ 

Example 2.9. 

h = + 00 , Hip= f A(9)ip{0)d6, H J U □ 

J- 00 (2/(0) = 9 , 2/o = 0. 
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Proceeding in this way with Example 2.10, it is readily seen that the map 
H must be defined on the Sobolev space W 1,p {—h, 0; R). 

Example 2.10. 

0</i<+oo, Hip = [ [Ar (0)^(0) + A 2 (O)ij>(O)]d0. □ 

J-h 

A complete theory is available in the product space 

M p = I x L p (—h, 0; R) (2.12) 

for systems of the form 

y(t) = Hy t + f(t), t > 0, y(0) = (p°, 2/o = </>\ (2.13) 

where / € Lf oc (0, oo; R), (^>°, c^ 1 ) € M p , and H is a continuous linear map 

H : IE 1,P (—/i, 0; R) —> R, 1 < p < oo, (2.14) 

for finite or infinite memory, 0 < h < +oo (cf. M. C. Delfour [8]). Moreover 
this class of maps cannot be enlarged in this framework. 

The construction used in Examples 2.8 to 2.10 does not apply to Exam¬ 
ple 2.11 because the map 

Hip = ip(— 1) 

would have to be defined on the smaller space C 1 (—1,0; R) 1 of continuously 
differentiable functions. To get around this difficulty, we group terms involving 
a derivative of x: 

- x(t - 1)\ =0 

and note that the above expression is of the form 

\iMx t = 0, = ^(0) - ^(-1). 

at 

This last construction suggests the more general model 

^j\Mx t \ = Lx t + /(<), t>Q,x 0 = (t>. (2.15) 

Equivalently by introducing a new variable y{t) 


{ Mx t — y{t) = g(t), t > 0, 

x 0 = (p 2 , 

y{t)~ Hy t - Lx t = f(t), t > 0, 

2 /( 0 ) = 0 °, yo = (p 1 , 


(2.16) 


we obtain a model that can handle Examples 2.11 to 2.13. 
1 Recall the notation C( — 1,0; R) for C([— 1,0]; R). 
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Example 2.11. ft = 1, Mip = V’(O) — ip(— 1), L = 0, and H = 0, 

{ Mx t - y(t) =0, t > 0, 
x 0 = </>, 

y(0 = 0, t > 0, 

2/(0) = Mcj). 


Example 2.12. ft, = +oo, L = 0, and H = 0, 

Mrp = ij){ 0 )- f A{9)^{e)d9 1 

J —oo 

r - 2/(t) = /(f), f > 0, 

I x 0 = 0, 

I y(t) =0, f > 0, 

12 /( 0 ) = 0 . 


(2.17) 


□ 


(2.18) 


(2.19) 


□ 


Example 2.13. h = N, L = 0, and II = 0, 

N 

Mip = i/>( 0) — ^ Aiip(-i), 
2=1 

{ Mx t - j/(f) =0, f > 0, 

£o = <t>, 

y(t) =0, f > 0, 

2 /( 0 ) = 0 . 


( 2 . 20 ) 


□ 


The last example requires an additional operator N in model (2.16): 
(Mx t -Ny t = B 1 u t +g(t), t > 0, 

< y(t) - Hy t - Lx t = B 0 u t + /(f), f > 0, (2.21) 

[a’o = </> 2 , t/o = </>\ u 0 = w. 

Example 2.14. 2.7 h = N, L = 0, 

Mip = ip( 0), 2VV» = C'oV'(O) + Ciip(-N), 

N N 

< Hil> = '52'K~i), = ( 2 - 22 ) 

2 — 0 2=0 

= K 0 tp(0) + KnPi-N). 
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The interesting feature of the application of model (2.21) to Example 2.7 is 
that the observation x becomes one of the unknown variables similar to y: 

(y(t) - Hy t = B 0 u t , t > 0, 

< 2/(0) = 0°, yo = <fi 1 , u 0 = w, (2.23) 

(x(t) - Ny t = Bru t , t > 0. 

□ 

So the final mathematical model we shall adopt for our analysis will be 
(Mx t -Ny t = B 1 u t + f(t), t> 0, 

< y(t) - Hy t - Lx t = B 0 ii t + g{t), t > 0, (2.24) 

{(y(0),yo,x o ) = u 0 = w. 

This model has been studied in detail by M. C. Delfour and J. Karrak- 
CHOU [1, 2], with appropriate assumptions on the various maps. 


2.2 Orientation 


Model (2.24) is generic of a very large class of delay systems with finite or 
infinite memories. Our objective is to discuss the choice of state and state space 
for linear control systems with observation. We first consider Lipschitzian 
delay-differential equations of the form 

(x(t) = f(t,x t ), t> 0, ^ 2 25 ) 

1 x 0 = (j> 


and then specialize to time-invariant linear control systems of the form 


x(t) = Lx t + B 0 u t + f(t), t > 0, 
xo = ^ 


(2.26) 


with observation equation 


y(t) = Cx t + B 0 u t . (2.27) 

The complete theory for the general model (2.24) can be found in M. C. Del- 
FOUR and J. Karrakchou [1, 2]. It was felt that the specialization to system 
(2.26)-(2.27) was sufficient as a first introduction and will better illustrate 
the ideas and constructions behind our approach using product spaces and 
structural operators. 

In §3 we discuss the existence and uniqueness of the solution for Lip¬ 
schitzian systems of the form (2.25). We compare the classical assumptions 
for initial conditions in the space of continuous functions with those required 
for initial conditions, which are only L p -functions. In this last case we also 
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need an initial point to define the starting point of the trajectory. This is 
the so-called product space approach because the initial datum is a pair 
(0°,0 1 ) € K" x L p (—h, 0; K"). A key result is that all time-invariant lin¬ 
ear systems can be studied in the product space framework under the same 
assumptions as in the continuous functions framework. This last result is of 
paramount importance for control problems because the state space can be 
chosen as a Hilbert or a reflexive Banach space bringing delay systems in line 
with partial differential equations in Hilbertian or reflexive Sobolev spaces. 

In §4 we construct a first state and a state equation, study transposed and 
adjoint systems, introduce structural operators, and intertwining operators, 
and characterize adjoint semigroups and their infinitesimal generators. This 
is the extension of the traditional state in the continuous function framework. 
In particular the reader will find the implicit characterization of the adjoint 
of the infinitesimal generator associated with the state for systems with both 
finite or infinite memory. This question was initially raised by R. B. Vin¬ 
ter [2], but its importance has not always been fully appreciated. We shall 
see how fundamental it is in the following sections. This section also contains 
many other key technical results, which will be extensively used in subsequent 
sections 

Section 5 introduces the control variable and the two fundamental choices 
of definition of the state. Section 6 incorporates a delayed observation equation 
and extends the two definitions of state to finally obtain an evolution equation 
and an observation equation in a product space R" x L p x L p without delays 
but with unbounded control and observation operators. 

This chapter will emphasize the importance of the construction of a state, 
which is fundamental in Control Theory. For delay systems this key devel¬ 
opment seems to have come from N. N. Krasovskii [1, 2] in 1959. Yet the 
use of the nonreflcxive Banach space of continuous functions at the level of 
the classical theory of semigroups was not completely satisfactory for a purely 
technical reason. Around 1969 it was then understood that for a very large 
class of delay systems the state space could be enlarged from continuous func¬ 
tions to an initial point and an initial L p -function. This led to the product 
space approach , which was independently introduced in the late sixties-early 
seventies by M. Artola [1, 2, 3] for parabolic partial differential equations 
with delays, M. C. Delfour [1, 3, 5, 8] and M. C. Delfour and S. K. Mit- 
ter [2, 3, 4, 5, 9] for nonlinear time-varying delay differential equations, and 
Ju. G. BORISOVIC and A. S. Turbabin [1] for nonhomogeneous linear time- 
invariant delay differential equations. 

At that time our objective was to bring the theory of systems with delays in 
line with the modern theory of partial differential equations in Hilbert spaces 
and build up a unified Control Theory of Infinite Dimensional Systems. In 
that regard delays systems were very appealing as they were halfway between 
ordinary differential equations and partial differential equations. This techni¬ 
cal contribution made it possible to give a complete mathematical solution 
to the linear quadratic optimal control problem over finite and infinite time 
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horizons (cf. M. C. Delfour and S. K. Mitter [3, 6, 8]; M. C. Delfour, 

C. McCalla, and S. K. Mitter [1]; M. C. Delfour [3, 6, 9, 10, 12, 13, 
15]; M. C. Delfour, E. B. Lee, and A. Manitius [1]). In the context of 
numerical solutions the product space also turned out to be the appropriate 
framework because it was disconnecting the initial point and the initial func¬ 
tion (cf. M. C. Delfour [6]). For subsequent work by many other authors 
(Banks, Burns, Gibson, Herdman, Ito, Kappel, Kunisch, Rosen, Schappacher, 
Tran, and several others), the reader is referred for instance to the papers of 

D. Salamon 4], and I. Lasiecka and A. Manitius [1] and their bibliogra¬ 
phies. 

Another important contribution was the construction of the structural op¬ 
erators , which first clarified the relationship between the true adjoint and the 
transposed system and provided the natural concepts of observability and con¬ 
trollability. They were developed in Montreal in the 1975-78 period and first 
announced in December 1976 at the CDC by A. Manitius [5] and at the IN- 
RIA by M. C. Delfour and A. Manitius [1]. For control systems without 
delays in the control variable, the transformation of the state by the structural 
operator was introducing a new state, the structural state, which was more 
natural and better adjusted to the specific delay structure of the system. A 
complete treatment of structural operators along with their implications in 
spectral theory was given by M. C. Delfour and A. Manitius [2, 3] for 
arbitrary delay functionals L on the space of continuous functions (see also 
C. Bernier and A. Manitius [1], and A. Manitius [5, 6, 7, 8]) immediately 
saw and exploited their potential in the study of the notions controllability 
and observability. An extention of structural operators to time-varying sys¬ 
tems was later done by F. Colonius, A. Manitius, and D. Salamon [1], 
But it turned out that structural operators and the associated construction 
of the structural state also play a fundamental role in the transformation of 
systems with delays in the control variable into an evolution equation without 
delays. The appropriate extention of the definition of structural state 2 in R n x 
L p was introduced by R. B. Vinter and R. H. Kwong [1] and generalized 
by M. C. Delfour [15] to general delayed control operators. We still call it 
structural state because it roughly corresponds to the transformation of the 
usual state and the segment of the control function by the structural operators 
associated with the delay structure of the system and the control. Another 
state in K™ x L p x L p , the extended state, was introduced by A. Ichikawa [1, 
2, 3]. This state follows the evolution of the pieces of trajectory x t and control 
Ut . He added Ut to the original choice (x(t),Xt) for the state in the product 

2 In the recent literature the terminology “forcing function state” has been used (cf. 
for instance the book by G. Grippenberg, S. O. Londen, and O. Staffans [1]). 
This emphasizes one of the many properties of the underlying semigroup. It is ob¬ 
viously a matter of taste. For instance we shall see in the proof of Theorem 5.1 that 
this state can also be seen as the resulting product of transposition techniques. 
In fact the underlying semigroup is nothing but the adjoint of the semigroup 
associated with the state of the transposed system. 
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space. This theory will be completed and extended in §5.2. To our knowledge 
those two definitions of the state seem to be the only interesting and natural 
ones for linear control systems with delays. In retrospective—and it is now 
more striking because we have a unified framework for the time-invariant 
system (see §2.1)—it is extremely interesting to see that these two notions of 
state had been discovered by D. H. Miller [1] around 1974 in the context 
of Volterra equations. 

All this was fine but not quite complete. From the Control Theory point 
of view it was necessary to be able to deal with a delayed observation equa¬ 
tion. This is relatively simple to do with the extended state because we have 
direct access to ay and w t . However this was far from being obvious with the 
structural state. The appropriate construction came from D. Salamon [2] 
who added a third component to the structural state. This extended struc¬ 
tural state does not require a full knowledge of ay and u t but only of some 
linear combinations through appropriate structural operators associated with 
the control and observation delay structure. This construction was extended 
and generalized to system (2.24) by J. Karrakchou [1] and M. C. Delfour 
and J. Karrakchou [1, 2], Similar developments using a slightly different 
approach were also done by D. Salamon [1, 3] for neutral systems. 

We would like to emphasize that our objective in this chapter is to give 
a systematic introductory but sufficiently complete treatment of the above- 
mentioned material, which is not available in standard textbooks. We feel that 
it is now a fundamental part of the theory of delay systems, which brings them 
in line with the general theory of control systems in infinite dimension. 

The optimal control problem will be covered in the second part of this 
book. However it will appear as a special case of the general theory. Never¬ 
theless many references have been included at the end of this chapter. For 
early papers using various forms of the Maximum Principle, Dynamic Pro¬ 
gramming, and abstract variational theories, the reader is referred to the first 
books of G. L. Kharatishvili [1] and M. N. Oguztoreli [1] in 1966 and 
the papers by H. T. Banks and A. Manitius [1] in 1974, F. Colonius [1] 
in 1982, and the lecture notes of A. Manitius [4] in 1976. 

Many papers deal with the theory of partial differential equations with 
delays. It was unfortunately not realistic to include this material here. The 
reader is referred to M. Artola [1, 2, 3, 4], and especially the bibliography 
in M. Artola [4] on the work of the Italian School; A. Ardito and P. RiC- 
CIARDI [1]; G. Di Blasio, K. Kunisch, and E. Sinestrari [1]; J. Dyson 
and R. Villella-Bressan [2]; K. Kunisch and W. Schappacher [1]; and 
C. C. Travis and G. F. Webb [1, 2], 

2.3 Notation 

R denotes the field of real numbers, and for an arbitrary integer n > 1, R" 
will be the n- dimensional Euclidean space. The norm of x in R" and the 
inner product of x and y will be written \x\ and x ■ y , respectively. 
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Given —oo < a < b < +oo, 

I (a, b) = lfl [a, b ]. 

For a real Banach space X , L p (a,b;X) will denote the space of all equiva¬ 
lence classes of p-integrable (resp. essentially bounded) Lebesgue measurable 
functions on /(a, b) into X for 1 < p < oo (resp. p = oo). The derivative of a 
function x on I (a, b) into X will be denoted x, dx/dt, , Dx , or D t x (in the dis¬ 
tributional sense). The Sobolev space of all y in L p (a, 6; X) with distributional 
derivatives D J t y,j = 1,..., m, in L p (a, 6; X) will be written W m,p (a , b ; X). 

C(a,b;X ) will be the Banach space of all bounded continuous functions 
x from I(a,b) into X. For m > 1, C m {a 1 b\ X) will be the space of all m- 
times bounded continuous differentiable functions on I(a,b). Co(a,b', X) = 
{x £ C(a, b; X ): Ve > 0, 3 a compact subset K of I(a, b) such that |x(f)| < £, 
Vf £ K c }, where K c is the complement of K with respect to I (a, 6), 

K c = {t £ I(a,b): t ^ K} | 

when a and b are finite I(a, b) = [a, b] and Cq and C coincide. C c (a , b; X) will 
be the subspace of functions of C{a , 6; X) with compact support in ]a, b[. It is 
not to be confused with the space of bounded continuous functions with sup¬ 
port in /(a, b). In general the two spaces do not coincide except on /(—oo, oo). 
In addition to the above function spaces, we shall also use the notation. 

T\ oc {a, oo, X) = {y : /(a, oo) -> X: VT > a, 2 /| /(a>T) £ X(a,T-X)} 

for any function space T (for instance T can be C, L 2 , W 1,p , etc. ...). 
V(\a, 6[; R") will denote the vector space of all infinitely continuously dif¬ 
ferentiable functions from ]a,6[ into R". W™’ p (a, b; R") will be the closure of 
X>(]a,&[;R n ) in W m ’ p (a, b; R”). 

Given the integers n > 1 and k > 1, and real numbers p, 1 < p < oo, and 
h, 0 < h < +oo (possibly h, = +oo), we shall use the following notation for 
the two product spaces, which will frequently occur in this chapter: 

M p = R” x L p (-h, 0;R"), 

Z p = R” x L p (—h, 0; R") x L p (-h, 0;R fc ). 

Whenever confusion is possible, subscripts n and/or k will be added. 

Given a real number p, 1 < p < oo, and an integer t>\, the elements of 
the topological dual L p (a, 6;R f )' of L p (a, 6;R f ) will be identified with those 
of L q (a , b; R £ ), where q is the conjugate of p, p -1 + q~ l = 1. Similarly (M p )' 
and ( Z p )' will be identihed with M q and {Z q )' , respectively. 

Given a real measure /i on a a -algebra of subsets of a set S, \p\ will denote 
the total variation of p (cf. W. Rudin [1, pp. 117 118]. The total variation of 
an n x m matrix /3 of real measures {flij : 1 < i < n, 1 < j < m} is dehned as 
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= EElA: 


. i =1 j =l 


1/2 


where \(3%j\ is the total variation of fy. 


3 Existence theorems for Lipschitzian systems 

All examples in §2 implicitly suggest the introduction of a product space as the 
space of initial conditions. In this chapter we present some general existence 
theorems for Lipschitzian systems in both the continuous function and the 
product space framework. In this way the reader will be in a better position 
to appreciate the relative advantages and limitations and, more importantly, 
the complementarity of the two approaches. 


3.1 Continuous functions framework 


We have seen that a delay system is characterized by the length of its memory 
h, 0 < h < +oo. When h < +oo, we say that the system has a finite memory 
and when h = +oo an infinite memory. The notation 

I(h, 0) = [—h, 0]ni (3.1) 

will be very convenient to simultaneously deal with [—h, 0] when h is finite 
and ] — oo, 0] when h is infinite. Denote by C(—h, 0; R") the space of bounded 
continuous functions from I(—h , 0) —» ! iV . When h = +oo it is not a Banach 
space and its elements are not necessarily uniformly continuous. So we could 
use one of the subspaces 


Ce(— oo, 0; R n ) = < </> £ C(— oo, 0; R"): lim <f>(6) exists > , 

6 —> —oo 

C 0 (—oo,0;R”) = <j C(-oo,0;R n ): lim 0(0) = 0 \ . 

0 —> —oo 


(3.2) 


In this chapter we choose the second subspace and introduce the following 
uniform notation for the space of initial conditions: 


K(—h, 0; R”) = 


C(—h, 0; R"), if h < oo, 
Co(—oo, 0; R"), if h = oo. 


(3.3) 


We shall see in Lemma 3.5 that this is a natural choice because for p, 1 < p < 
oo, IT 1,P (—oo, 0; R") C Co(—oo, 0; R"). Given a function 


/: [0,oo[ x K(—h, 0;R”) 


(3.4) 


we consider the differential equation 
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|§(«) =/(«,*,). t>( I, (3 . 5) 

l^xo = (j> € K(—h , 0; R"), 

where ay : I(—h, 0) —> R™ is defined from the solution x : [0, oo[ —> R" and the 
initial condition f> as follows: 


x t {0) 


x(t + 9), —t < 9 < 0, 
(j)(t + 9 ), 9 < —t 


(3.6) 


for 9 in I(—h, 0). 

Theorem 3.1. Assume that the function f in (3.4) verifies the following as¬ 
sumptions: 

(HI) for each f> in K(—h, 0;R"), the function 


1 1 —> /(£, <t >): [0, oo[ —> R” 


(3.7) 


is Lebesque measurable, 

(H2) there exists a non-negative locally integrable real function n such that for 
all (f >i and (j >2 in K(—h, 0;R") 

\f(t,<h) ~ i)l < n(t)\\<h - Me, (3.8) 

(H3) and the function 

f(t,0): [0,oo[->R n (3.9) 

is locally integrable. 

Then, given any initial condition <j> in K(—h, 0;R n ), there exists a unique 
absolutely continuous solution x = x(-',<p) to system (3.5) on [0, oo[. Moreover 
for each T > 0, there exists a constant c(T) > 0 such that for all <j)\ and <j> 2 
in K(—h, 0; R n ) 

||^(s <fo) — x(-; 0l) || U / 1 ’i(o,T;E n ) < c(T)\\<f>2 — <fii\\c, (3.10) 

where 1T 1,1 (0,T;R”) denotes the space of absolutely continuous functions from 
[0, T\ to R" with a derivative in L 1 (0,T;R”). 

This theorem is not the only existence theorem that is available. It has 
been presented with a set of assumptions that contains as a special case linear 
systems ; that is, when the map /(£, </>) is affine in 

f(t,<t>) = L(t)<j> + /(£). (3.11) 

However it is easy to modify the set of assumptions (HI) to (H3) to obtain local 
versions. Similarly for non-Lipschitzian functions /, it is possible to obtain the 
analog of the classical Caratheodory conditions and local existence theorems 
(cf. J. K. Hale [1, 3]). 

The proof of Theorem 3.1 necessitates the following two classical lemmas. 
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Lemma 3.1. Let T > 0 be fixed and assume that assumptions (HI) to (H3) 
are verified: 

(i) For each z in K(—h,T;l& n ) the function 


t*-> f(t,zt): [0, T] —> K" (3.12) 

belongs to L 1 (0,T;K."), where 

z t (0) = z(t + 9), 9 G I(—h, 0), t> 0. (3.13) 

(ii) For all pairs 

(0 1 ,® 1 ), (/,i 2 )eAHO;R")xC(0,T;K”) (3.14) 

such that 0 1 (O) = a: 1 (0) and </> 2 (0) = x 2 (0) and all t in [0,T] 


\f(s, (x 2 ) s ) — f(s, (x 1 ) s )| ds, 


< [ n(s)max{\\<j) 2 - ^Wc+ \\x 2 - x 1 \\ C (o,s)}ds. 
Jo 


(3.15) 


Proof, (i) By definition of the space K{—h, 0; R n ) each of its element is a 
uniformly continuous function and the function t i—> z(t) = Zt belongs to 
C(0, T; K(—h, 0; R")). In particular 

z G L^O.T; if(-/i,0;R n )) 


and there exists a sequence of step functions s n : [0, T] —> K{—h, 0;K n ) that 
converges pointwise to z for almost all t in [0,T] and converges globally in 
the L 1 norm. To show that the function (3.12) is measurable, it is sufficient 
to establish the following two properties: 

1- fn(t) = f(t,s n {t)) -> f(t) = f(t,z(t)), a.e. in [0,T], 

2. for all n, f n is Lebesque measurable on [0,T]. 

Then the function / will be Lebesque measurable as a pointwise limit of a 
sequence of Lebesque measurable functions. 

By assumptions (H2) for each t the map <j> i—> f(t, <j>) is continuous and 
necessarily 

fn{t) = f(t , s n {t)) -> f(t) = f(t, z(t)) (3.16) 

as n goes to infinity. This proves property 1). For property 2) it is sufficient 
to establish that for each step function s, the function f s (t) = f(t,s(t )) is 
measurable. By definition a step function is of the form 


k 

s(t) = ^2aiX A .(t), at G K(-h,0;R n ), 

i =1 


(3.17) 
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where r > 1 is a positive integer and the H/s are disjoint measurable subsets 
of [0, T] such that the measure of their union 

r 

A = |J Af 

i=1 


is finite (x A . is the characteristic function of Ai). So f s can be rewritten as 

r 

f(t,s{t)) = /(t,0)[l ~XA(t)} +^2f{t, a i)XA i (t)y 

i— 1 

which is the sum of r + 1 measurable functions by assumptions (HI). 

To show that /(f) is integrable, we evaluate its L l - norm 

\f(t,z t )\dt < [ \f(t,0)\dt+ f |/(t, zt) — /(t, 0) | dt 
Jo Jo 

and use assumption (H3) for the first term and assumption (H2) for the second 
term, which is bounded by 

n(t)\\z t — 0||cdt < ||«||L 1 (0,T;R)||2 : ||c(-ft,T;R")- 

(ii) By choice of q i* and x l , s i—> {x l ) s belongs to C(0,T-,K(—h, 0;M n )) and 
the conclusions follow from part (i) and the Lipschitzian assumption (H2). □ 

Lemma 3.2. Let a,0 < a < 1, be a real number and n be a non-negative 
function in oo;R): 

(i) The function 




g a (f)=exp|iy n(s)dsj, t > 0, 


is monotonically increasing and greater than or equal to 1. 

(ii) For all t > 0 

/ n(s)g a (s)ds < ag a (t). 

Jo 

(iii) For all T > 0 and x in C(0,T;WL n ) the quantity 

IMIc a ( 0 ,T;R") = SUp {|| X{t)/g a {t)} 
te[o,T] 

is an equivalent norm on the Banach space (7(0,7^") and 
1 


9a{T) 


l^llc < I < Ikllc- 


(3.18) 


(3.19) 


(3.20) 


(3.21) 
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Proof, (i) is obvious, (ii) is obtained by differentiating g a (t ), and the equiva¬ 
lence of the norms in (3.21) follows by definition of the norm (3.20). □ 

Remark 3.1. The introduction of the function g a for global existence problems 
is due to A. Bielecki [1], It plays the same role as Gronwall’s inequality. □ 

Proof of Theorem 3.1. The initial condition (f) is fixed. For each x in 
C(0,T;M. n ) such that x = 0(0), define the function Fx 

(Fx)(t)=4>( 0) + f f (s, x s ) ds, 0 < t < T. 

Jo 

In view of Lemma 3.1 , F maps the closed subset 


S = {x G <7(0, T; IT): ®(0) = (f{0 )} 


of C(0,T;R") onto itself. We now prove that for all a, 0 < a < 1, F is a 
contracting map on S. So by the Banach fixed point theorem we get existence 
and uniqueness of the solution to Fx = x or 

x(t) = 0(0) + f f{s,x s )ds, 0 <t<T. (3.22) 

Jo 


Given x and y in S 

\(Fy)(t) - (Fx)(t)\ < I \f(s,y s ) — f(s,x s )\ ds. 
Jo 


By assumption (H2) and inequality (3.15) in Lemma 3.1, the right-hand side 
is bounded by 


max 

re[o,t] 


I y{r) - x{r) | 
9a{r) 


n(s)g a (s) ds 


and in view of (3.19) in Lemma 3.2, 


I (Fy)(t) - (Fx)(t )| < ag a (t)\\y - x|| c „(o,t;R")- 

Finally 

II Fy — F 1 a;||c , C( (o,T;R n ) < oi\\y — ^lIccfo.TjR 11 ) 

and (3.22) has a unique solution in S. Moreover s i—> f(s,x s ) belongs to 
L 1 (0,T;R") and necessarily x belongs to IF 1,:L (0, T; R n ). 

To obtain the estimate (3.10) let x 1 and x 2 be the respective solutions of 
(3.22) for (j) 1 and </> 2 . Then 

|a^ 2 (*) — ^ X (*)l < I0 2 (O) — 0 1 (O)| + [ \f(s,x 2 )- f(s,xl)\ds, 

Jo 

and by using inequality (3.15) the integral term is bounded by 
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\\n\\mo.T-,R)U 2 - ^\\c + [ n( S ) max{||a; 2 (r)-a: 1 (r)||}(is. 

Jo 0<r<s 

Now use (3.21) on [0, s ] for the last integral, which is bounded by 

/ ?r(s)g a (s)||:r 2 - £ 1 ||c c ,(o, S ;R'*) ds < ag a {t)\\x 2 - z 1 ||c C( (o ) t;R’W 

Jo 


Finally 


\x 2 (t) - a; 1 )*)! < [1 + \\n\\ L i {0tT) ]\\(j) 2 - ftWc + ag a (t)\\x 2 - x 1 ||c o (0,T;R-), 

(1 - a)||a; 2 - a^llc^o.TjR") < (1 + lkl|.L 1 (o,:r))||0 2 - <kll c, 
and in view of (3.21) 

Ik’ 2 — ® 1 ||c( 0 ,T;R n ) < f - a ^ + ll n IU 1 ( 0 ,T)]|k 2 ~ ^\\C- (3.23) 

For the derivative we again use (3.15) 

I \& 2 - x'Wli < \f(t,x 2 ) - f(t,x])\dt 

< IlnlUimaxdl^-^llcll^-^llc}, 

and by combining (3.23) and (3.24), we obtain (3.10). □ 

Remark 3.2. The proof of Lemma 3.1 is essentially the original proof given by 
C. Caratheodory [1] in 1927 generalized to Banach spaces. □ 


3.2 L v or product space framework 


We shall see now that in many cases, it is possible to separate the initial 
point a:(0) of the solution x to the differential equation (3.5) from the piece of 
function xo on /(— h, 0), which is necessary to make sense of the right-hand 
side of (3.5). This will lead us to consider an initial condition as a point and 
a function 

(j)= (0°,0 1 ) e M p =l"xL p (4, 0 ; r) (3.25) 

in the product space that will be denoted M p , where p, 1 < p < oo, is a fixed 
real number. For the reader interested in the origin of the letter M, it was 
just the letter next to L. 

As in §3.1 we start with a function ) that is defined for (f> in 
K(—h, 0;R"). When q i 1 is an L p function the segment 


x t (0) 


x(t + 9), —t<9< 0, 

0 1 (t + 9), 9 < -t, 


(3.26) 


9 £ I(—h, 0), is generally not a continuous function in K(—h, 0;R"), but only 
an L p (—h, 0; R ra ) function. So we cannot expect to give a pointwise meaning 
to the function t e-> f(t, x t ): [0, oo[ —> R". 
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Example 3.1. Consider the function 


f{t,<t>)=a{t)</>(- 2), <f> € C(—2, 0; R), (3.27) 


where a is measurable and bounded on [0, oo[. Then the function 

t 1 —> fit., x t ) = a(t)x(t — 2): [0, 2] —> R (3.28) 

belongs to L p ( 0, 2; R) for all x in L p {— 2, 2; R). □ 

Unfortunately not all functions fit , <t>) are extendable as can be seen from 
the next example. 

Example 3.2. Consider for </> £ C(— 2,0;R) the function 


fit, <t>) 


<t>{t- 1), 0<t< 1, 
0, t> 1. 


For all continuous functions x in C(— 2,2;R), the function 


t ^ f{t,x t ) 


x{- 1), 0<t< 1, 


[0,2] —> R 


(3.29) 


(3.30) 


is well defined and discontinuous at t = 1. However it has no extension to 
functions x in L p {— 2, 2; R). □ 

Nevertheless we shall see later that the family of functions / that can be 
extended to L p initial conditions includes all linear time-invariant systems 
that are of the form 

f{t,<j>)=L<t> + f{t), (3.31) 

where L is linear and continuous from K(—h, 0: R") into R" and f belongs to 
Lj^O.oojR"). 

The following theorem is the counterpart of Theorem 3.1. 

Theorem 3.2. Fix the real number p, 1 < p < oo, and h, 0 < h < +oo. Let 
the map f given in (1.4) verify assumptions (HI) to (H3) in Theorem 3.1 and 
the following additional assumption: 

(H4) there exists a real non-negative monotonically increasing function such 
that for all t > 0 and all z 1 and z 2 in C c (—h,t; R") 



l/(s,(z 2 ) s )-/(s,( 2 1 ) s )|ds 



i/p 


-^(s)r ds 


< m{t) 


(3.32) 
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Then, given any <f> = in M p = R™ x L p (— h, 0; R"), there exists a 

unique absolutely continuous solution x = x(■',</>) to the system 

l> °’ (3.33) 

\ (x(0), x 0 ) = {0°, (fr 1 ) = <t> G M p . 

Moreover for each T > 0, there exists a constant c(T) > 0 such that for all 
<j>i and, 4 >2 in M p 

Il a: ('i <h) — x(--, 0l)||w 1 . 1 (O,T;K’») < c (^) II <^2 — 011| Mp , (3.34) 

where 

hu* = ik/.^iim. = nr+n 1 \\u 1/p - ( 3 . 35 ) 

To complete this section we now give the proof of the last two theorems. 
Theorem 3.2 necessitates two lemmas similar to the ones used in the proof of 
Theorem 3.1. 


Lemma 3.3. Fix the real numbers p, 1 < p < +oo, T > 0 and h, 0 < h < oo. 
Assume that assumptions (HI) to (H4) are verified. Associate with each z in 
C c (—h,T; R") the function f z in L 1 (0,T;K") defined as 

f z (t) = f(t,z t ), 0 <t <T. (3.36) 

Then the map 

f z -. C c (—h,T;R n ) —> L 1 (0,T;R") (3.37) 

extends to a unique uniformly continuous map from L p (—h,T-R n ) into 
L 1 (0,T;R"). Moreover for all t in [0,T] and z 1 and z 2 in L p (—h, T;R”), 

f \f(s, ( 2 : 2 ) s )-/(s,(^ 1 ) s )|ds< m(t)\\z 2 - z 1 \\ L p(_ Kt . m n ) . (3.38) 

Jo 

Proof. By Lemma 3.1 to each z in C c (—h , T; R"), we can associate a function 
f z in L 1 (0,T;R n ) defined by (3.36). By assumption (H4) for all z 1 and z 2 in 
C c {-h,T- R”) 


II fz 2 — fz 1 1|L 1 (0.T;R n ) S m (T)\\ z — ^ ||L«>(-/i,T;R n )• 

Thus the map (3.37) is uniformly continuous for the L p (—h,T-, R") topol¬ 
ogy. By density of C c (—h, T; R") in L p (—h,T; R n ), it has a unique uniformly 
continuous extension to all L p (— h, T; R"). As for inequality (3.38) we use as¬ 
sumption (H4) on [0 ,t] and bound m(t) by ni(T) for 0 < t < T. □ 

Lemma 3.4. Let a, 0 < a < 1, p,l < p < oo, and c > 0 be fixed real 
numbers: 
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(i) The function 

g a (t) = exp (-) - , t> 0, (3.39) 

\a/ p 

is monotonically increasing and greater than or equal to 1. 

(ii) For all t > 0 

c\\g a \\LP(0,t-,R) < ag a (t). (3.40) 

By introducing the norm (3.20) with g a given by (3.39), we also have the 
equivalence of the norms on (7(0, T;R") and inequalities (3.21). 

Proof. Differentiate g a {s) p with respect to s and integrate with respect to s 
from 0 to t, 

T, s “ { ‘ r = (£) 9 " (s) '- 

c p g a (s) p ds = a p [g a (t) p - 1] < a p g a (t) p . □ 

Proof of Theorem 3.2. The proof follows the same pattern as the one of 
Theorem 3.1. The initial condition <f) = (</> , </r) is fixed. For each x in the 
closed subset 

S = {x G <7(0, T; IT): *(0) = (f°} 
of C(0,T;R"), define the function 

(Fx)(t) = (f 0 + f f(s,x s )ds , 0 <t<T. 

Jo 

The map x i—> Fx is well defined from S to S. We prove that for any a, 0 < 
a < 1, F is contracting on S and apply Banach fixed point theorem to obtain 
the existence of a unique x in S such that Fx = x or equivalently 

x(t) = (jP + f f(s,x s )ds, 0 <t<T. 

Jo 

Given x and y in S 

\(Fy)(t) - (Fx)(t)\ < f \f(s,y s ) — f(s,x s )\ ds. 

Jo 

By (3.38) in Lemma 3.3, the right-hand side is bounded by 

m(t)\\y- £|| L p ( o, quin). 

Construct the function g a (t) in (3.39) with c = m(T). Then 

I (Fy)(t) - (TV)(t)| < m(T)\\y — a;||c ct(0 ,t ; R" ) ll3a||LP ( o,i ; R ) 

< oig a (t)\\y - x\\ Ca (o,t;B. n ) 

and F is contracting for the norm C a . From this point on the proof is essen¬ 
tially the same as the one of Theorem 3.1. □ 
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3.3 Linear time-invariant systems 

The price to pay for initial conditions in L p is the extra assumption (H4). 
However (H4) is always verified for linear time-invariant systems of the form 
(3.31). 

Theorem 3.3. Assume that the map f(t, (jf) is of the form (3.31) for f in 
Ll oc (0, oo; R ra ) and a continuous linear map 

L : K(—h,0\R n ) —> R” : (3.41) 

(i) There exists a n x n matrix of regular Borel measures such that 

L(j>= [ dgr](j)(e), \/<j>eK(-h, 0;M n ). (3.42) 

J-h 

(ii) The four assumptions (HI) to (H4) are verified for all real numbers p, 
1 < p < oo. Moreover there exists a constant c > 0 such that for all (t, s), 
0 < s < t, and all z in C c (— h, t; R") 



1/p 

rt+e 

/ \Lz r \ p dr 

< c||? 7 || sup 

/ \z{r)\ p dr 

Js 

eei(-h, o) 

J S + 0 


where ||? 7 || is the total variation of the matrix rj. 

(iii) Given T > 0, introduce the continuous function Cz, 

(Cz)(r) = Lz r , r > 0, 

for each z in C c {—h, T; R") and the map 

z i —> Tz i C c (-h , T; IT) -> L p { 0, T; R"). 


(3.43) 


(3.44) 


(3.45) 


Then for any T > 0 the map C has a continuous linear extension to 
L p (-/i,T;R n ) 


C: L p (-h,T;R n ) -> 

and for all pairs (s, T), 0 < s < T, 

L p (0, T; K") 

(3.46) 

\\Lz\\ L p {S}T) < ||??|| sup 

{ k \\lp(s+6,T+0)- 

(3.47) 


0Gl(-h, 0) 


(iv) For all x in W 1 ’ p (—h,T; R") and t> 0 



(£i)(s) ds = Lxt 


Lx o, 


(3.48) 


where x is the first derivative of x. 
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Proof, (i) By the Riesz’s representation theorem (cf. W. Rudin [1, p. 131, 
Theorem 6.19]). 

(ii) It is easy to check that assumptions (HI) to (H3) are verified. As for 
assumption (H4) we use Fubini’s theorem applied to complex measures (cf. 
W. Rudin [1, Chapter 6 and p. 140, Theorem 7.8]). For all z l and z 2 in 
C c {-h,t; R n ) 



I f{s,zl) - f(s,zl)\ds 



< [ ds [ dg \r)\ I z 2 (s + 6) 
Jo j-h 


z\s + 6) |. 


As the integrand is continuous with compact support in I(h, 0) x [0,t], it is 
m x 77 measurable (m, the Lebesgue measure) and after changing the order of 
integration 



de H 



ds\z 2 (s + 9) 


z 1 (s + 0 )| < m(t)\\z 2 


LP(-h,t\ R"-)) 


where for t > 0 


m(t) 


1 1 / <z , 1 < p < 00 , 

1, P= 1, 


and ||? 7 || is the total variation of 77 on I(—h, 0 ). 

We have established (3.43) for p = 1 because it is a special case of (H4). 
For 1 < p < 00 consider for any / in C(0,f;R 11 ) the following expression for 
0 <s<t: 


f(r) ■ Lz r dr 


< 


dr dg\r]\\f(r)\\z{r + e)\. 


l-h 


Again the integrand is a continuous function on I(—h, 0) x [0, t] with compact 
support. Hence it is measurable and Fubini’s theorem can again be used to 
change the order of integration in the last integral 



dr\f(r )| \z(r + 0)\ < 


l-h 


de \v\ ll/lll/ 7 (s,i) ll-^llL p (s+£,i+$) 


and 


f(r) ■ Lz r dr 


< \\f\\L*( s ,t) [ dg \T)\ \\z\\ L p {s+ g tt+ gy 

J-h 


By density of C(0,t;IR") in L 9 (0,t;R"), we obtain (3.43) for all z 
in C c (—h, i; R”). 

(iii) The continuous linear extension of (3.45) again follows by density of 
C c {—h,t\ R n ) in L p (— h, t; R n ) and inequality (3.43). 

(iv) The proof of this part requires the following lemma. 
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Lemma 3.5. Let i > 1 be an integer and p, 1 < p < oo, T > 0 and h, 
0 < h < +oo (possibly +oo), be real numbers. Then 

W 1,p (—h, T; R”) C K(-h, T; R") (3.49) 


with continuous injection. 

For x in W 1,p (—h,T; R"), the difference 


Lx t - Lx o = L(xt - x 0 ) 

is well defined and continuous. For x in W 2,p (—h, T; R"), 

rt-\-Q 

(x t — xo )(9) = x(t + 9) — x(0) = / x(s) 

Je 

and 


ds 


/ O pt-\-6 pO pt pt pO 

deg x(s)ds = / deg x(s + 8)ds= / ds dggx s (6). 

-h Je J-h Jo Jo J-h 


Hence for all t in [0, T] 

Lx t -Lx o = [ ( Cx){s ) ds, Vx G W 2 ' p {-h, T; R”). 

Jo 

Now by density and continuity this last result is true for all x in W 1 ,p (— h, T; R"). 

□ 

Proof of Lemma 3.5. Any element x of W 1,p {—h, T ; R") is almost everywhere 
equal to a bounded continuous function x on I(—h,T) (cf. 
R. A. Adams [1, p. 97, Theorem 5.4]) and the injection in the space of 
bounded continuous functions is continuous. This proves the lemma for h 
finite, and we only have to deal with the case h = +oo. 

To complete the proof it is now sufficient to show that x{t) goes to zero 
as t goes to —oo. For all pairs (s, s'), — oo < s < s' <t 

x(t) = x(s') + / x(r) dr. 

J s' 

Take the L p norm with respect to s' from s to t 

(t - s) 1/p \x(t)\ < ||x|| L p (S)t;K <) + {t- s)||a:|| iP(s>t . R ^ ) . 

But x = x in L p (s, t; R f ) and for all f < T and s = t — 1 
\x(t)\ < 2 1_1/p ||x|| V yi,p ( _ 00)t;R < ) . 

For each e > 0, there exists T' < T such that 


V t <T', ||a;||rv 1 .P(_ 0 o,t;R«) < £ 

and by combining the last two inequalities 

Ve > 0, 3 T' < T such that Vf < T, |ir(t)| < e. 

Therefore x belongs to Co(—oo, T ; R^). □ 
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4 State space theory of linear time-invariant systems 

In this section we fix p, 1 < p < oo, and specialize to linear systems 

x(t) = Lx t + /(f), t> 0, 

(*(0), x 0 ) = (/, 0 1 ) G MP = R B x LP{-h , 0; R”), 

where / belongs to Lf oc (0, oo; R") and L is a continuous map 

L : K(—h, 0; R”) -> R n . 


(4.1) 

(4.2) 


4.1 Preliminary results and smoothness of the solution 

We have seen in §3.2 that the right-hand side of the first equation (4.1) makes 
sense for x in Lf oc (—h, oo; R") even if L is only defined on the space of contin¬ 
uous functions. This situation is not really surprising because we are dealing 
with initial conditions in an infinite dimensional space and the real state of 
the system at time t is an appropriately defined piece of function on the time 
interval I(t — h,t). In fact two states are considered that are fundamental in 
the theory of delay systems. A traditional difficulty in the various theorems 
and proofs we shall encounter is the notation. A good notation will simplify 
the computations and make all the arguments precise in both the finite and 
the infinite memory case. For instance we have introduced the notation Cx in 
Theorem 3.3, which is more precise and compact than the traditional nota¬ 
tion Lxt . In addition we shall need the following notation to restrict or extend 
functions by 0. 

Definition 4.1. Let t > 1 be an integer and a and 6, a < b, be two real 
numbers. Let iF(a,6;R^) be a set of functions from [a, b] to R f . For each u in 
.F(a, b; R c ) and all s, a < s < 6, define the functions e s _ u and e s + u as follows: 


I(o, 00) —> R^, 

II 

's' 

CO 1 

[0, 

a <t < s, 

s < t < 00, 

(4.3) 

: I(-oo,b) -+R e , 

{e+u)(t) = | 

fo, 

—00 < t < s, 

s <t < b. 

(4.4) 


□ 


In other words the subscript “+” indicates that we keep the function u on the 
right (positive direction) of s up to b and set it equal to zero on the left of s 
down to —oo. Similarly the subscript “ —” indicates that we keep the function 
u on the left (negative direction) of s from a and set it equal to zero on the 
right of s up to + 00 . The construction is illustrated in Figure 4.1. 
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(a) u on [a, 6] 




Fig. 4.1. The functions u, e+u, and el it. 


Remark 4.1. In the sequel we shall often make use of the composition Ce° + of 
the maps 

e° : 27(0, T;R”) -> 27(-oo,T; R n ) 

and 

C: 27(—oo, T; R") -> 27(0, T;R"). 

□ 

Theorem 4.1. Let p, 1 < p < oo, and h, 0 < h < +oo, be real numbers and 
f G Lf oc (0, oo; R") and </> = (</>°, 0 1 ) G M p (4.5) 

be given: 

(i) The system 

x = Cx + f , (x(0),x o ) = <t> (4.6) 

has a unique solution x in W ^ ( f (0, oo; R”). Moreover, for all T > 0, there 
exists a constant c(T) > 0 such that 

11*^11 VK 1 ’ p (0,T;E n ) < c(T)[||</>||m p + ||/||lp(0,T;R")]- (4.7) 

(ii) When 

(f 1 G W 1 ’ p (-/i,0;R") and <t>° = <^(0), (4.8) 

the solution x of (4.6) belongs to IT 1,P (— h, T; R") for all T > 0 and 
there exists c(T) > 0 such that 

||a;||w 1 .P(-/i,T;R n ) < c(T)[||0 1 || tV i,P + ||/||lp( 0,T;R p )]- (4.9) 
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Remark 4.2. In fact part (i) can be slightly improved. It is possible to show 
that for any continuous linear map 

L: W 1,p (—h, 0; 1") —> R", (4.10) 

system (4.6) has a unique solution x in Ci oc (0, oo; R") when (4.6) is interpreted 
in an appropriate weak sense (cf. M. C. Delfour [8]). □ 


4.2 First state equation 


Starting with the homogeneous system 

x = Cx, (x(0), xq) = 4> G M p , 


(4.11) 


we can construct the following semigroup of continuous linear transformations 
on 

0i-> S(t)</> = (x(t),x t ): M p -> M p , t> 0. (4.12) 

Theorem 4.2. Let p, 1 < p < oo, and h, 0 < h < +oo, be real numbers and 
L: K(—h, 0;R") —> R" be linear and continuous: 

(i) The family {S(t ): t > 0} of transformations of M p defined by (4.12) 
forms a strongly continuous semigroup on M p . 

(ii) Its infinitesimal generator is characterized by 

T(/,</» 1 ) = (^ 1 ,^ 1 ) (4.13) 


for all (j> = (cj) 0 ,^ 1 ) in the domain D(A) of A 


D(A) 


(/,^)G M p 


cj) 1 G kF 1,p (—ft, 0;R")1 
and (j)° = ^(0) J ’ 


(4.14) 


where Dcj) 1 denotes the first derivative of (j) 1 . 


Notation 4.1. In view of the structure of the elements of D(A) we shall use 
the notation if for both the function if in W 1,p {—h, 0; K") and the element 
(V’(O), if) of D(A). □ 

Notice that from the definition of D(A) and A, the largest family of maps 
L that generates a strongly continuous semigroup {5(t)| on M p is precisely 
the one of Remark 4.2. This result clearly indicated that the state space 
theory of other types of delay systems such as the neutral type could not be 
obtained from systems of the form (4.11) (cf. M. C. Delfour [8] for more 
details). To complete the picture we immediately give the second theorem for 
the nonhomogeneous case, which will require an important technical lemma. 
All proofs will be given at the end of the section. 

Theorem 4.3. Assume that the assumptions of Theorem 4.2 are verified and 
that x is the solution in Wj^(0, oo; R”) to (4.6) for f G Af oc (0, oo; R"): 
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(i) For all t > 0 the state 


is well defined and 


x{t) = {,x(t),x t ) 


x(t) = S(t)<fi + f S(t — s)(/(s),0) ds. (4-15) 

J o 

// </> G D(A), then for all t> 0, x(t) G D(A). 

(ii) For 1 < p < oo and q its conjugate, g _1 + p^ 1 = 1, x is a solution of the 
system 


i^ <'ip,x(t) > +( A *ip,x{t))+'ip 0 -f(t), t> 0, ^ 41g ^ 

\*(0) =ct>, VV- G D(A*), 

where A* is the infinitesimal generator of the semigroup {S*(t)} on M q . 

(iii) Given p and q as in part (ii) for all T > 0, x is the unique solution in 


V(0,T;M P ,D(A* 


= {ze (7(0, T; M p ): — i*z G L p { 0, T; D{A*)') 


(4.17) 


to the following equation in D(A*)': 

ij t i*x(t) = (A*)*x(t) + i*(f(t),0), t> 0, 

U(0) = 


(4.18) 


where i* and (A*)* are the topological dual maps of the continuous linear 
maps 

i: D(A*) -> M q , A *: D(A*) M q , 

where i is the canonical dense injection of D{A*) into M q and D{A*) is 
endowed with the graph norm topology defined by 

M D(A-) = m q M , + \\A*nU 1/q - (4-19) 

Remark 4.3. This theorem will be generalized in §5.2 to systems with delays 
in the control variable. □ 


Equation (4.17) is the first example of a state equation for delay systems. 
It is to be interpreted in the weak sense (4.16). This result is an abstract one 
because we have not yet characterized D(A*), which is quite different from 
D(A). In most situations (4.15), (4.16), or (4.17) will be sufficient. However 
we shall give other definitions of states and state equations that are different 
from x(t) in (4.15). 
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Terminology 1. The pair (x(t),Xt) associated with the solution x of system 
(4.6) will be called the state of system (4.6) and denoted x(t). The correspond¬ 
ing semigroup {S'(t)} defined by (4.12) will be referred to as the semigroup 
associated with the state. 

This is the natural extension of the traditional terminology for the state 
Xt in the space of continuous functions. Fundamentally {S(t)} is a translation 
semigroup acting on the concatenation of the initial function and the solution 
x of system (4.6). The terminology initial function state and initial function 
semigroup is also used in the recent literature as in the book of G. Grippen- 
berg, S. O. Londen, and O. Staffans [1]. 

We now proceed to the proof of the two theorems, which will necessitate 
the following important technical lemma. 

Lemma 4.1. Let p, 1 < p < oo, q, q + p _1 = 1, and T > 0, be real and 
£ > 1 be an integer: 

(i) The function u belongs to L p {—h,T;M. e ) if and only if the function 


1 1 —► (u.)(i) = u t : [0, T] -> L p {-h , 0; (4.20) 

is continuous. Moreover for all u in L p (—h,T;M. e ), allt, 0 < t < T, and 
all if in Wq’VM;]^), 

D t {lp,Ut)L*xLP = -(Dglf,U t )LixLP- (4.21) 

(ii) The following three properties are equivalent: 

u G W 1 ’ p (—h,T;M e ), (4.22) 

u. G C 1 (0, T; L p (-/i, 0; R*)), (4.23) 

u. . G (7(0, T; W hp {-h, 0; R*)). (4.24) 

Moreover in each case 

D t Uf = Dg Ut, 0 < t < T, (4-25) 

and the equality holds in C(0, T; L p (—h, 0); K f ). 


Proof, (i) For any u in C c (—h,T;M . e ) the function (4.20) is well defined and 
continuous and the map 

u u. : C c (—h, T; R*) (7(0, T; L p (-h, 0; R e )) (4.26) 

is linear and continuous for the L p -topology: 

[ \u t {o)\ p de = f \u(t + e)\ p dd<\\u\\ p T . Re 
J— h J — h 
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As a result the map (4.26) has a unique continuous linear extension to all 
L p (-h, T; R e ). Conversely if u. G C(0, T; L p (-/i, 0; R f )), 

Vf G [0, T], u t £ L p {-h,0;M. e ) => u G L p {-h,T-,R e ). 


To compute the vectorial distribution derivative of u . consider the following 


expression for p in V(\0,T[) and ip in Wq ' q (—h, 0; R l ): 


fT 

E= (lp,Ut)LixLP-p-(t) dt 
Jo dt 


r T r° 

dt / 

0 J-h 


dp 


d9ip(9) • u(t + 9)—(t). 


Notice that e + h ip is the extension by 0 of the function 'ip on I(—h, 0) to ] — oo, 0]. 
As ip(—h) = 0, e+ h ip G tT 1,<? (—oo, 0; R^). Change the variable 9 to s = t + 9 
and extend the bounds t — h and t to — h and T: 


E = — f dt [ ds(e, h ip)(s — t) ■ u(s)^f-(t) 

Jo Jt-h dt. 

= ~J dt J ds(e+ h ip)(s -t) ■ u(s)^(t). 


Now change the order of integration and integrate by parts with respect to t : 
E = [ ds [ dt^-(e'l h ip)(s — t) • u(s)p(t). 

J-h Jo dt + 

Then change the order of integration once again and change the variable s 
back to 9 = s — t 


rT 

,T-t r 

HO 

II 

/ d9 

Jo 

/ —h—t 


d9 


(e+ h m) 


' u(t + 9)p(t) 


dt f d9^j-(9) • u t (9)p(t). 

(XU 


' — h 


This establishes (4.21). 

(ii) If u G W 1,p (—h, T; R^), then the derivative u G L p (—h , T ; R^) and from 
(i) the function t ( u) t belongs to C(0, T; L p (—h, 0; R^)). So it is sufficient 
to establish that Du t = (ii)t to conclude that u. G C 1 (0, T ; L p (—h, 0; R f )). We 
use identity (4.21) 


-(D e ip,u t ) = - j ^(0) ' u ( f + 9)d9 = J ip(9) ■ u(t + 9) 

o 


d9 


ip(6) ■ u(t + 9)d9 = (ip, ( u ) t ) 


' —h 
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and necessarily Dut = ( u)t■ So (4.22) implies (4.23). To show that (4.23) im¬ 
plies (4.24) again use identity (4.21): For all t in [0, T] and ip in Wq ’ g (—h, 0; R^) 

(t/y Du t ) = D t (ip,u t ) = -(Dgtp,u t ). 


Therefore 

Dut = Dg ut , 0 < t < T (4.27) 

and t i—> Dgut belongs to C(0, T; L p {—h, 0; R^)). But we already know from 
part (i) that u t G C(0, T; L p (—h, 0; R^)) and necessarily 

u. G C(0, T; W 1,p (—h, 0; R f )). 

Finally we show that (4.24) implies (4.22). For h = +oo, 

u T G 1F 1,P (—oo,0;R £ ) =4«G ^^(-oo.TsR^). 

For h finite 

Vt G [0, T], u t G W 1,p (—h, 0; R^) => € W 1,p (t — h, t; R^), 

and because the interval [—h,T] is finite, u G W 1,p (—h,T\ R f ). In the process 
we have established (4.26). This completes the proof of the lemma. □ 

Proof of Theorem 4.2. (i) This is a direct consequence of Theorem 4.1. 

(ii) By definition of D(A), for each <f> in D{A) and T > 0, the function 

1 1 -> Sftff) = ( x(t),x t ) 

belongs to C 1 (0,T;M p ). In particular x G C(0,T;R") and 

x, G C 1 (0, T; L p {-h, 0; R")). 

Now by Lemma 4.1 (ii) x G W 1,p (—h, T; R") and 

<f>° =x(0) =</> 1 (0) and (j) 1 G W 1,p (—ft, 0;R n ). 

Conversely if </>° = </> 1 (0) and p 1 G W 1,p (—h, 0; R”), then by Theorem 4.1 
(ii) for all T > 0, the solution x to (4.11) belongs to W 1,p (—h,T; R"). By 
Lemma 4.1 (ii), 

x, G C 1 (0, T ; L p (—h, 0; R”)) and D t x t = Dgx t 

and by continuity of D t Xt 

lim D t Xt = lim Dg Xt = Dg ch l in L p (—h , 0: R"). 
t\,o t\,o 

As for the R”-component we use identity (3.48) in Theorem 3.3 (iv): For all 
x in W 1,p (—/i,T;R"), Cx belongs to L p (0,T;R n ) and 
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Lxt = Lx o + / (£x)(s) ds. 

J o 

Therefore 

limidi) = lim Lx* = Lx o = Lcb 1 . 

t\ o t\o 

We have shown that 

lim D t x(t ) = lim D t (x(t),x t ) = (Lff^Dg (j) 1 ) in M p . 

So 0 G D(A), which is characterized by (4.14). Moreover we have also estab¬ 
lished identity (4.13) and this completes the proof. □ 

Proof of Theorem 4.3. (i) By linearity it is sufficient to establish (4.15) for 
0 = 0. In that case 0 = 0 verifies assumption (4.8) in Theorem 4.1 (ii) and 
the solution x of (4.6) is such that for all T > 0 

x G T; R") and ®(0) = 0. 

Hence e° + x G W 1,p (—h, T; R n ) and by Theorem 4.2 (ii) 

x(t) = (x(t), (e+x)t) G D(A), Vf > 0. 

In particular 

^(t) = L(e° + x) t + 

and from Lemma 4.1 (ii), e° + x G C(0, T; W 1,p (—h , 0; R n )) and 
^(e+x) t = D g (e° + x) t , t> 0. 

Hence 

J^x(t) = Ax(t) + (f(t), 0), a.e. in [0, oo[, x(0) = 0. 

Now from semigroup theory (cf. Chapter 1, Proposition 3.1), we conclude that 
(4.15) is verified. 

(ii) From part (i) we know that x G Ci oc (0, oo; M p ) and that M p is re¬ 
flexive. Therefore {S'(t)} has an adjoint semigroup {5*(t)} on ( M v )' with a 
densely defined inhnitesimal generator A* with domain D{A*). So for all 0 in 
D(A *), we rewrite (4.15) in the following weak form: 

faM(t)) = (S*(t)0,0) + [ (S*(t-s)'ip,(f(s),0))ds 

Jo 

and 

^(0,x(t)) = (S(t)*A*0,0 }+J (S*(t-s)A*i>, (f(s),0))ds+(ip, (f(t),0)) 

= (A*ip,x(t)) + {if,(f(t), 0)). 
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This gives the weak expression (4.16). 

(iii) Rewrite (4.16) with the canonical injection and take the duals of i 
and A* to get (4.18), and this gives the characterization of x as an element of 
V(0, T; M p \ D(A*)') in (4.17). The uniqueness is obvious. □ 


4.3 Transposed and adjoint systems 


In the previous sections we considered the system 


x(t) = Lxt, t > 0, (x(0), xq) = <p € M p (4.28) 


associated with the continuous linear map L: K(—h, 0;R") —> R" and con¬ 
structed the semigroup {S(t)}. In Theorem 3.3 in §3.3, we have associated 
with L a representation in terms of an n x n matrix of regular Borel measures 

L(j) — f dg r}(j){9). (4.29) 

J-h 


If we denote by the transposed of the matrix r), then we can introduce a 
new continuous linear map 


r 0 

L t : K(—h, 0; R”) —> R", L T ip = dgrj T ^{0), 

J-h 

and for each T > 0 and q , 1 < q < oo, the continuous linear map 

(C T : L*(-h, T ; R") L®(0, T; R"), 

1 (C T z){t) = L T z t , Vt > 0, Vz G C c (—h, T ; M”). 


(4.30) 


(4.31) 


For L t and C T we have the analog of Theorem 3.3 in §3.3. 

Definition 4.2. Let q, 1 < q < oo, be a real number: 

(i) For ij) in AI q and g in Lf oc ( 0,oo;R") the transposed system is defined as 

z = C T z + g, (z(0),z o ) = (ip 0 ,^ 1 ) e M q . (4.32) 

(ii) The transposed semigroup {5 T (f)} is defined as 

S T (t)4> = (z(t),z t ), t > 0, ip G M q , (4.33) 

where z is the solution of (4.32) with g = 0. □ 

The system (4.32) and the semigroup (4.33) associated with L T have the 
same properties as system (4.6) and the semigroup (4.12) associated with L. 
So the results in the previous section apply with L T , 5* T , and q in place of 
L, S, and p. In particular the infinitesimal generator A T of the semigroup 
{S T (t)} is given by 
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D(A t ) 


{ip^ip 1 ) G M q : 


ip 1 G W 1>9 (-/i,0;]R n ) 
ip° = ip 1 { 0) 


A T (ip 0 ,ip 1 ) = (L T ip 1 ,DiP 1 ). 


(4.34) 


Notation 4.2. It will be convenient to use the notation ip for both the element 
ip of W 1,q (—h, 0; K") and the element ip = (ip( 0), ip) of D(A T ). The canonical 
injection of D(A T ) into M q will be denoted by j 

ip = {ip( 0), ip) jip = W>(0), ip): D(A t ) -> M 9 . 


□ 


The transposed semigroup |S' T (t)} is however not equal to the topological 
adjoint semigroup {S 1 *^)} of {5(f)}. This is a very fundamental aspect of 
the theory of delay systems with deep implications for Control Theory. Work¬ 
ing with (4.6) for x will yield an “adjoint system” that is equivalent to the 
transposed system (4.32) with a change of variable from t to T — t. However 
working with the state equation (4.18) will yield an “adjoint system” in AI q 
characterized by the adjoint semigroup {5*(t)}. Of course there is a connec¬ 
tion between the two approaches that is a consequence of the “intertwining 
theorem” between S'(t) and S*(t) by the structural operator F, which will 
be introduced in the subsequent sections. 

Terminology 2. The pair (z(t),Zt) associated with the solution z of system 
(4.32) will be called the transposed state of system (4.32) and denoted z(t). 
The corresponding semigroup {^(t) 1 ^} defined by (4.33) will be referred to as 
the transposed semigroup. 


The first technical result is an “integration by parts” formula that relates 
systems (4.6) and (4.32). 

Lemma 4.2. Let T > 0, p, 1 < p < oo, and q, q~ 1 +p~ 1 = 1, be real numbers. 
Then for all x in W^O.TjM") and z in W 1,9 (0, T; 1R") 


f z(T — t)-[x — Ce+x](t) dt + z(T) ■ x(0), 

T 

= j [z — C T e° + z\(T — t) ■ x(t) dt + 2(0) • x(T). 

Jo 


Proof. It is sufficient to look at the term 


(4.35) 



z[T — t) ■ {Ce° + x)(f) dt. 


For x and z in C c (0, T; R”), x(0) = 0 and z(0) = 0, e° + x and e\z belong to 
C c (-h,T-,R n ), and 
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f z(T — t) • (Ce° + x)(t) dt = f z(T — t) ■ L(e° + x) t dt 
Jo Jo 

= ( z(T — t) ■ f dg rj(e+x)(t + 9) dt 

Jo J-h 

= f f dgr] T z(T — t) ■ (e+x)(t + 9) dt. 

Jo J-h 


After changing the order of integration 


f f dg r] T z(T — t) ■ (e+x)(t + 0) dt 

J-h Jo 

/»0 pT-\-Q 

/ / dg i^ T z{T — s + 9) ■ {e° + x){s) ds 

J-h Je 

[ ( dg r] T (e+z)(T — s + 9) ■ x(s) ds. 

J-h Jo 


Again change the order of integration 

= / L T (e° + z)T- s ■ x(s) ds 
Jo 

= f (C T e° + z)(T — s) ■ x(s) ds. 

Jo 

By density of C c (0,T;R”) in IA(0,T;R") and L«(0,T;R”) for all ^ in 
L«(0, T; R”) and x in U>{ 0, T; R”) 

f z(T — t) ■ (Ce° + x)(t) dt = f (£ t e° + z)(T — s) ■ x(s) ds. 

Jo Jo 

In particular it is true for z in M /1,9 (0, T; R") and x in W 1,p (0, T; R"). □ 

To complete this section we relate the solution 2 of the transposed system 
to the classical backward adjoint system. For simplicity we assume that 

ip 1 e W 1 ’^- M;R n ) and = 0). 

Under that condition system (4.32) can be rewritten as 

z(t) = L T z t + g(t) on [0,T]. (4.36) 


Now we introduce the variable 


p{t) = z(T-t), 0 <t<T + h. 


(4.37) 


I Pij) = -z(T - t ) 
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and 


where 


/ 0 pO 

d e r] T z(T -t + 9) = / dg ry T p(t - 8) = L 1 p l , 

-h J-h 


p\8) =p(t-8). 


Finally we obtain the backward adjoint system 

-^(t) = L r p t +g(T-t), 0 <t<T, 
( p(T),p T ) = (V’ 0 ,^ 1 )- 


(4.38) 


(4.39) 


In general for time-varying systems (4.39) will be the system to work with. The 
transposed system can only be obtained in the time-invariant case. Keeping 
this in mind and the fact that the remainder of this chapter is devoted to 
time-invariant linear systems, we have decided to avoid the backward adjoint 
system and work with the transposed system. 


4.4 Structural operators 

Structural operators are as fundamental to delay systems as Sobolev spaces 
to elliptic problems. They capture the fundamental structure of a delay sys¬ 
tem and play a key role in the characterization of the properties of stability, 
stabilizability, controllability, and observability. They were first announced in 
December 1976 for a finite number of delays by A. Manitius [5] at the CDC 
and by M. C. Delfour and A. Manitius [1] at the INRIA. A complete 
treatment was later given by M. C. Delfour and A. Manitius [2, 3] for 
arbitrary linear delay functionals L continuous on the space of continuous 
functions. 

There are many ways to introduce structural operators. Intuitively they 
describe the way the system combines and transforms initial conditions over 
the initial time interval 1(0, h). Go back to the linear homogeneous system 

x = jCx, (x(0), xo) = (ip°, X 1 ) € M p . (4.40) 

Then separate the solution x in II /1 ’ p (0, T; K") from its initial function q i 1 in 
L p (-h, 0;R") 

x = £e+x + Ce^cj) 1 , x(0) = (j>°. (4-41) 

System (4.40) does not directly use q i 1 but only its image Ce°_(j 1 . When h is 
finite 

OCe^Xf) = 0, t>h, (4.42) 

and it is sufficient to consider Ce^ej) 1 on the interval [0, h]. 

This suggests to associate with the function q i 1 on I(—h, 0) another func¬ 
tion Lcj) 1 on I(—h, 0) defined in the following way: 
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(Lcj) 1 )(a) = (£e° 0 1 )(—a), a G I(-h, 0). (4.43) 

In view of Theorem 3.3 (iii) in §3.3 

L: L p (-h,0-R n ) -* L p (-h,0-,R n ) (4.44) 

is a continuous linear transformation and we can rewrite (4.41) to emphasize 
the role of the pair (</>° , Lcj) 1 ) G M p 

[x{t) = (Ce\x){t) + (ef h L<t> 1 ){-t), t> 0, 

\x(0 )=<j>°. 1 j 


It is clear that the “real initial data” is the pair 

Fi^A 1 ) = ((f* 0 ,^ 1 ) G M p , (4.46) 

which defines a continuous linear transformation of M p . 

Definition 4.3. Let p, 1 < p < oo, and h, 0 < h < +oo, be real numbers: 

(i) The operator F defined in (4.46) will be referred to as the structural 
operator associated with L. 

(ii) The structural operator associated with L T is defined as 

f’ T «,^ 1 ) = (/,LY), (4.47) 


where 

(L T ip 1 )(a) = (C T a), a G I(—h, 0). (4.48) 

□ 


The following lemma gives further insight into the structure of F and its 
relationship to F T . 

Lemma 4.3. (i) For all <j> in K(—h, 0; R n ) such that <j>(0) = 0, 


(L(f>)(a) = [ dg r](f>(9 — a), Va G/(— h, 0), 

J-h 

Lcf) G K(—h, 0; R”), 

{L4>){-h) = 0, (L0)(O)=L0, 

/ cx. 

dg r] T 4>(d — a), Va G /(-ft, 0), 

-h 

L T 0G A^(-h,0;R n ), 

,(I T ^)(-/i)= 0, (I T 0)(O) = L t ^. 


(4.49) 


(ii) For any p, 1 < p < oo, and its conjugate q,q 1 + p 1 = 1, 

L* = L T and F* = F T , 
where L* and F* are the dual operators of L and F. 


(4.50) 
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Proof, (i) It is sufficient to establish (4.49) for L. The proof for L T is exactly 
the same. Given any </> in K(—h, 0;R"), e°_(f> G K{— oo, 0; R") is uniformly 
continuous and the function 


a ^ (e°.^)_ a : I{-h, 0) -» K(-h, 0; K") 


is also continuous. As L is continuous on K (— h, 0; R n ), the function 

a ( L(t>){a) = (, Ce°_<j>)(-a ) = L(e°_<j ))- a : I(-h, 0) -► K n 

is also continuous and (L<f>)( 0) = L(e° </>)o = L(j>. For h finite, (Lcj))(a) = 0 
for a < —h and by continuity ( L<f>)(—h ) = 0. For h infinite, ( Lcf>)(a ) —> 0 
as a —* —h because e°_(j) € AT(—oo, 0; R") and ( e°_(j))(a ) —» 0 as a —•> —oo. 
Finally the last two identities (4.49) follow by definition of L 

/ 0 ra 

do r]{e o _(j)){0 — a) = / dorj(j)(0-a) 

-h J-h 


because 


(e°_4>)(d — a) = 0 for 9 — a > 0. 


(ii) We compute the dual of L. For </> and if in C c (— h, 0; K 11 ) 


( if,L(f>) = f • (L<j>)(a) da 

J-h 

rO 


/ u /»0 

i/j(a) ■ / dg r](e°_<t>)(9 — a) da. 

-h J-h 


Change the order of integration and the variable a to £ = 9 — a 

/ 0 n0-\-h 

/ dg ry T if {9 - C) • (e°_<j>)(C) df 
-h Jg 

= [ [ dg rj T (e°_ip)(9 - () ■(/)(() d( 

J-hJ-h 

= [ d( [ dg r] T (e°_if)(9 — £) • 

J-h J-h 

= (L T i>A)- 


If the dual (L p )* of L p is identified with L q , then we obtain the first identity 
(4.50). The second one follows immediately from the first. □ 


4.5 Adjoint semigroup {S' T *(t)} and intertwining theorems 

The next theorem gives a complete characterization of the dual semigroup 
{S^*^)} of S T (t)} in terms of the structural operator F. This is the first 
step toward the so-called intertwining theorem. 
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Theorem 4.4. Fix the real number p, 1 < p < oo, and its conjugate q, q 1 + 
p~ x = 1, and identify the elements of (A'I P )* with those of M q \ 

(i) For all f = (£°,£ 1 ) in M p and all t > 0, 

S T *(t)f = F(x(t), {e° + x)t) + (0, r(f)^ 1 ), (4.51) 

where x £ Wi o ’^(0, oo;R n ) is the solution of the system 

x(t.) = {£e° + x)(t) + (e+ h ^)(-t), t> 0,x(0) = (°, (4.52) 

and r(t) is the right translation operator 

[t(£)u](0) = {ef h u){6 - t), 8 £ [— h, 0] (4.53) 

for any arbitrary function u defined on I(—h, 0). 

(ii) When £ = Ftp for some <p £ M p , then 

S T *(t)F(j) = F(x(t), x t ), t> 0. (4.54) 

Remark 4.4. We shall see in §5 that it is possible to construct a state x(t) and 
a state equation similar to (4.16) and (4.18) in Theorem 4.3 for x(t) in the 
nonhomogeneous case. We choose to do it later in the general case with the 
control term instead of doing the simple case here and repeating the argument 
for the control case. □ 

Corollary 4.1. Fix the real number p, 1 < p < oo, and its conjugate q , q~ x + 
p- 1 = 1, and identify the elements of (M p )* with those of AI q : 

(i) For all (, = (£°, C 1 ) in M q and all t > 0, 

S*(t)C = F{z(t), (e° + z) t ) + (O.r^C 1 ), (4.55) 

where z £ (0, o°; R") is the solution of the system 

z(t) = (£ T e° z)(t) + (e+b^i-t), t>0,z{0) = (°, (4.56) 

and r(t) is the right translation operator defined in (4.53). 

(ii) When £ = F*ip for some ip £ M q , then 

S*(t)F*ip = F*(z(t),z t ), t> 0. (4.57) 

To see the complete picture we immediately give the intertwining theorem 
of S' 1 "* and S with respect to F and the dual result as a corollary. The proofs 
will be given at the end of the section. The general version of the theorem 
is due to M. C. Delfour and A. Manitius [2, 3], for arbitrary linear de¬ 
lay functionals L continuous on the space of continuous functions (see also 
C. Bernier and A. Manitius [1] for a finite number of delays). 
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Theorem 4.5 (Intertwining theorem). Fix the real numberp, 1 < p < oo, 

and its conjugate q, q _1 + p _1 = 1. Denote by A T * the infinitesimal generator 
of the semigroup {5 T *(f)} on M p . Then the following properties hold and are 
equivalent: 

(i) S r *(t)Ff = FS(t)(j), V</> G MP, Vt > 0. 

(ii) FD(A) C D(A t *) and A T *F(f = FA<f>, \/(f G D(A). 

(iii) For all £ in the resolvent set of A 

R( C, A T *)F(j) = FR(C, A)<j), V0 G M p , (4.58) 

where R((, A) = [(I - A] -1 and R((, A T *) = [(I - A T *] _1 . 

Corollary 4.2. Fix p and q as in Theorem 4.5. If {S*(t)} is the dual semi¬ 
group of {S(t)} with infinitesimal generator A *, the following properties hold 
and are equivalent: 

(i) S* (f)F*cj) = F*S T (t)4>, V</> G M q . 

(ii) F*D(A t ) c D{A*) and A*F*<j) = F*A T (f), Mcj G D{A T ). 

(iii) For all (j in the resolvent set of A T , 

R(C,A*)F*(j) = F*R{C,A T )(j), \/<j)£M q . (4.59) 

Proof of Theorem 4.4. (i) Let 2 be the solution of the transposed system 

z = C T z, (z(0),^o) = (^/' 0 ,^/’ 1 )€M , . 

Let T > 0 be an arbitrary time. As x and 2 belong to VL 1,p (0, T; R") and 
W 1,q (0 , T; K"), respectively, we can use identity (4.35) in Lemma 4.2 and the 
fact that 

C T z = C T e° + z + C T e°_ if 1 . 

Then 


(1) d = [ T z(T - t) ■ (e+b&i-t) dt + z(T) ■ 

Jo 

(£ T e°'0 1 )(^ 1 — t) • x(t) dt + ip° ■ x(T) = f (2). 

Notice the two terms in f on the left-hand side (1) and the two terms in ^ on 
the right-hand side of (2). Change the variable t to 6 = — t in (1): 




z[T + 6) • (e; Y)(0) dd + z{T) • £° 


= / (e o + z) T (e)-e(0)de + z (T)-e 

J-h 

= (z T ,e)-((e o -^) T ,e)+z(T).e 


= — {{ e -'f’ 1 )T,t; 1 )LixLP- 
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By a simple change of variable 


[ (eVMa) • £V) da = [ ^{0) • (e+ h ^)(9 - T) d8 

J-h J-h 


and finally by definition of S T and r 

(l) = (5 T (T)V-,0-<^(0,r(TY)}. 

For the right-hand side we change t to a = t — T in (2) 

(2) = J (C T e°_ip 1 )(—a) ■ x(T + a) da + ip° • x(T) 


l-T 

r° --r- 

= / (L T tp 1 )(a) ■ (e° i _x)T{a) da + ip° ■ x{T) 

J-h 

= {F*ip, (x(T), {e\x) T ))M q x M p . 

By combining the above results for (1) and (2) we obtain (4.51). 

(ii) We need the following lemma, which will be proved at the end. 


□ 


Lemma 4.4. Let p, 1 < p < oo, be a real number and ip a function in 
L p {-h,0;R n ); then 

Vi > 0, r(t)(Z'0) = L(e°_ip) t . (4.60) 

When £ = Fcp, = Lcp 1 , from (4.60), r(T)(L(() 1 ) = L(e°_(p 1 )T, and hence 

(0,t(T)(Z<Y) =F(0,(e°_<p 1 ) T ) 


and 

S t *(T)£ = F(x(T), (e° x) T + (e° 4 )t) = F(x(T), x T ). 

Proof. Again we prove (4.60) for functions <p in C c (—h , 0; R") and extend it to 
L p (—h, 0; R n ) by density and continuity. By assumptions e°_(p € C c (—oo, 0; R") 
and for a in I(—h, 0) 

[T{t)(L<p)\(a) = [e+ h (L<p)\(a - t) 

_ \ L(e°_(p) t - a , t — a < h, 

1 0, t — a > h. 


For t — a < h 


r 0 

L(e°_(p)t- a = / dg r](e°_(p)(t — a + 9) 



dgii(e°_ 4>) t {6 


a) 


because 
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a < 6 < 0 => t < t — a + 9 < t — a => (e°_(f>)(t — a + 9) = 0. 
Hence for t — a < h 


[r(f)(Z^)](a) = [L{e°_(t>)t\{a). 


When t — a > h 

—h < 9 < a =4> 0 < t — a — h <t — a + 9 => {e°_cj)){t — a + 6) = 0 

and 

[L(e°_(/))t]{a) = 0. 

By regrouping the two cases we obtain (4.60). □ 

Proof of Theorem 4.5. (i) is a direct consequence of identity (4.54) in Theo¬ 
rem 4.4 (ii). The equivalence of (iii) and (i) is obtained by using the integral 
formulas between the resolvent and the semigroup. Finally (ii) is equivalent to 
(i) by the following lemma, which can be found in C. Bernier and A. Man- 
ITIUS [1]. □ 

Lemma 4.5. Let Y be a Banach space and K a continuous linear transfor¬ 
mation ofY. Given two strongly continuous semigroups {Ti(f)} and {T^t)} 
of bounded linear transformations of Y and their respective infinitesimal gen¬ 
erators Bi and B 2 , the following statements are equivalent: 

(i ) T i {t)K = KT 1 {t), t> 0. 

(ii) KD(B 1 ) C D(B 2 ) and B 2 K = KB 1 on £>(Bi). 

4.6 Infinitesimal generators A T * and A* 

Theorem 4.4 has provided a characterization of the adjoint semigroups {S' T *(t)} 
and {S*(t)}, which has a more complex structure than {S' T (t)| and {5(f)}. 
So the next step is to characterize their infinitesimal generators A T * and A*. 
Of course they will inherit of the complexity of the adjoint semigroups. This 
question was initially studied by R. B. Vinter [2], but its importance was 
not fully appreciated at that time. This characterization was not easy to ob¬ 
tain because its final form was not known. It is one area where the structural 
operator has provided simplification both in the characterization and in the 
proof of the result. One source of difficulties was the search of an explicit defi¬ 
nition of the infinitesimal generator of the adjoint semigroup. In the following 
theorem, we give an implicit characterization or definition , which turns out 
to be a more general and flexible result that applies to systems with finite or 
infinite memory. 

Theorem 4.6. Assume that the hypotheses of Theorem 4.4 are verified: 
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(i) The infinitesimal generator A T * of {S T *(t)} is characterized as follows: 


D(A t *) 


Z = Fcf>+ (O,C),0 €D(A), 1 

Ce W 1 >P(-/ l ,0;K n ),C(-/t)=0j 


(4.61) 


and the map 

C = F(j) + (0, C) = FA(j> + (C(0), -DC ): D(A r *) -* M p (4.62) 


is independent of the choice of the representation of f in terms of(<f,C). 
(ii) The infinitesimal generator A* of{S*(t)} is characterized as follows: 


D{A*) 


£ = *> + ( 0 , 0 , cfeD(A T ), 1 

Ce C(-h) = oj 


(4.63) 


and the map 

C = F*cj) + (0, C) >-»• H*C = F*A T (j) + (C(0), -DC): D(A*) -► M q (4.64) 


is independent of the choice of the representation of C in terms of((f>,C). 


Remark 4.5. For h finite we can choose a representation for D(A J *) of the 
form 


Z = (Z°, LC° + <), = (L? + C(0), -DC), 


where £° denotes the constant function equal to on [— h, 0]. This choice can 
be found in the early papers on the topic but does not extend to h = +oo. □ 


Proof. It is sufficient to prove (i). The proof of (ii) is identical up to a change 
in the superscript T . We have already established in Theorem 4.5 (ii) that 

FD(A) C D(A t *), A r *F(f> = FA</>, \/(f £ D(A). 


Hence for all C of the form F<f>, (f> £ D(A), 

A t *C = FA<j) = F(L(j>, D(f>) = LD(j>). 

Now we can always associate with an arbitrary f in D(A T *) an element (jA £ 
W 1,p (—h, 0; R”) such that </> 1 (0) = £° and decompose f in two terms 

Z = (Z^Z 1 ) = (Z 0 ,^ 1 ) + (CU 1 - Lf> 1 ) = F(t> + (0,0, 


where by construction 


(€°i Lcf 1 ) = (^(O), Lcf 1 ) = F(</> 1 (0), (f 1 ) 


and (</> 1 (0), (f 1 ) £ D(A). In view of the previous remarks it is now sufficient 
to characterize the elements of D(A T *) of the form (0,£). 
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Given (0, () € D(A T *), let x and y in oo; R") be the solutions of 

the systems 


\x(t) = (jCe° + x)(t) + (e+ h O(-t), 

( 40 ) = 0 , 

= ( Ce\y){t) + (e;"4 T *(0,C)] 1 )(-i), 

\y(o) = [A T *(o,c)]°- 

Notice that 

VT > 0, e\x € W 1,p (—h, T; R ra ). 

Define 

*(*) = S T *(t)( 0,0, m = S T *(t)A T *( 0,0- 

By Theorem 4.4 (i) 


(4.65) 

(4.66) 


x(t) = F(x(t), {e\x ) t ) + (0,r(t)C), 
m = F(y(t), (e° + y) t ) + (0,r(t)[A T *(0,C)] 1 ) 


and for (0, C) G D(A T *) 


dx 

dt 


(t) = y(t), \/t> 0. 


In particular 


Define for t > 0 


dx 

dt 


(t)=y(t)^xeW?*(0, OO -,R n ). 


X(t) = f y(s)ds, t> 0 and X(t) = 0, t € I(—h, 0) 
Jo 


and notice that 

X = e° x, X = e° + x = e° y. 
Integrate (4.66) from 0 to t 


(4.68) 


X(t) = [A r *( 0,C)]°+ f\ce° + y)(s)ds + f (e+ h [A T * (0, C)] 1 )(-s) ds. 
Jo Jo 

In view of Theorem 3.3 (iv) and (4.68) 

[ ( Ce° + y){s ) ds = [ (CX)(s) ds = LX t - LX 0 = LX t 


and 
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X(t)=LX t + [A r *( 0,C)]°+ f* {e+ h [A T *(0, C)] 1 ) (— s ) ds. (4.69) 

Jo 

As x{t) = X(t),t > 0, the right-hand sides of (4.65) and (4.69) are equal and 
in view of the fact that X = e° + x 


(e+ h 0(~t) = [A T *(0,C)]°+ f*\e+ h [A T *(0, C)] 1 )(—s) ds. 

Jo 

Introducing the new variable a = —t for —t G I(—h , 0), we obtain 

C(a) = [A T *(0,C)]°+ [ [A^C)] 1 ^, ael(-h, 0). (4.70) 

J Ot. 

Hence 

(e^K0;r), 

C(o) = [A T *(0,C)]°i = —[A t *(0,c)] 1 - 

When ft, = oo, we know by Lemma 3.5 that 

c G W llP (- 00 ,0; R") => C G Cq (— oo, 0; R") =► C(-oo) = 0. 

For ft finite we go back to (4.65) and 


x = y€ w£ p (0, oo; K n )^ie Q oc (0, oo; R n ) 

VT > 0, e° + x G W hp (-h, T; R") =4- Ce%x G <7(0, T; R"). 


So 


{e- + \){-t)=x(t)-{Celx)(t) 

is continuous for t > 0 and in particular continuous at t = ft. But 

f > ft=> (e+ h C)(-t) = 0 =4- C(-M = 0 . 

So we have established that 


C G IW^-ft, 0; R”), C (~h) = 0 (4.72) 

and that 

^ T *(0,C) = (C(0),-CaC). (4.73) 

Conversely given £ verifying (4.72) and x the solution of (4.65), we want 
to prove that (0, £) G D(A T *) or equivalently that for all t > 0 

dx , . , , ~ 

— (f) exists m M p , 


where x is given by (4.67). Specifically we shall show that 
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§(() = r(i(()4 ( ^).) + () (4 ' 74) 

and that 

is continuous. By Theorem 4.1 (ii) e([_a: G W 1,p (—h, T;R”) for all T > 0 and 
by Lennna 4.1 (ii) 


(e°a;). G C 1 (0, T; L p (—/i, 0; R")) 


and the function 


t -^(e+a :) t : [0, oo[ -> L p (-h , 0; R”) 

is continuous. By assumption (4.72) on (, 

e ~ h ( e W 1>p (-oo,0;R") 

and because the function r(t)( is a shift of the function e7"£ the function 
1 1 — > r(t)C: [0oo[ — ■> L p (—h, 0; R") 

is C 1 and 

^r(t)C = -r(<) DC 

is continuous. To show that x is continuous we prove that the right-hand side 
of (4.65) is continuous. The continuity of the term (e+ ,l C)(— t) for t > 0 follows 
from the fact that e+^C belongs to W 1,p (— oo, 0; R"). Similarly by Lemma 4.1 

(ii), 

e+a: G W 1,p (—h, T; R”) 

implies that 

(e° x). G C(0, T; W hp (-h, 0; R")) 

and necessarily 

1 1—> (£e+a:)(t) = L(e+x) t 

is continuous. So by definition of x and continuity of F we obtain (4.74), the 
existence of (t) as a continuous function of t and therefore (0, C) G D(A T *). 
We have established that any element £ of D(A T *) is of the form 


and that 


C = D0 + ( 0,0, 

4> G D(A), 

SeW^i-h, 0;R n ), C(~h) = 0, 


(4.75) 
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= FAtj) + (C(0), -DO = {Lcj) + C(0), LDcj) - DC). 

To complete the proof we have to show that A r *£ is independent of the 
representation of £ in terms of cj> and £. By linearity it is sufficient to establish 
that for all cj in D{A) and £ verifying (4.72) 

C = F<t> + (0, C) = 0 =► = FAcj + (C(0 ),-DO = o 

or for cj € W 1,p {—h, 0;M") such that £(— h) = 0 

0(0) = 0 |l^ + C(0) = 0, 

Lcj + C = 0 [LDcj- L>C = 0. 1 ' 

This will require the following lemma. 

Lemma 4.6. Let p, 1 < p < oo, be a real number: 

(i) For all cj in W 1,p {— h, 0; M”), the map 

F(j) = (0(0), Lcj) i-> Lcj) (4.77) 

is well defined, linear, and there exists a constant c > 0 such that for all 
<j> € W 1 ' p (—h, 0; M”), 

\L(f>\ < c[|0(O)| + \\Lcj\\ p + \\LD<t>\\ p \. 

(ii) For all cj in W 1,p {—h, 0; M") such that <j{0) = 0 

LtjteW^i-h, 0;R"), (L<t>)(-h) = 0, 

(Lcj) (0) = Lcj), D g Lcj) = -LDg <j>. 

Going back to the proof of the theorem, cj) satisfies the conditions of 
Lemma 4.6 (ii) and from (4.76) 


(4.78) 

(4.79) 


c 



-jum 

LDg (j). 


-Lcj>, 


This completes the proof of the theorem. □ 

Proof of Lemma 4.6. (i) By linearity the map (4.77) is well defined if 

(cj(0),Lcj) = 0 => Lcj) = 0. 

But by Lemma 3.5, W 1,p {—h, 0; K") C K{—h, 0; R”) and by Lemma 4.3 

cj g K(—h, 0; R”), cf(0) = 0 => (Lcj))(0) = Lcj) 

and necessarily Lcj = 0 ==> L<j> = {Lcj){ 0) = 0. For the continuity we associate 
with cj) € W 1,p {—h, 0; K"), the function 
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= tei(-h, o), 

u \m, t> o. 

For all T > 0, 0 G kF 1,p (—/i, T; R") and 

0 = D t j> = e°_D g 0. 

Then by Theorem 3.3 (iv), for all a £ l(—h,0) 

r0 p0 

/ {LD 0 (t>)(0) d.0 = / {£e°_D e dO = L4>_ a - L<j>. 

J a J a 

Let t = h if h is finite and r = 1 if h = oo. Then taking the L p norm on [0, r] 
T X l p \L<\>\ < c\\LDg </>||iP(_ft,0) + ||£0 ||lp(O,t)- 

But 

£0 = £e°_0 + = £e° 0(0) + Ce°_(t> 

and 

L p ( 0 ,r) < c||e°(/>(0)|| i p(_ ?lir )-|-||Z(/)|| i p(_ fti o) < c ' rl ^ P | < / , (0)| + ||i'^||iP(-/i,O)- 

Combining the last inequalities we get (4.78). 

(ii) When 0(0) = 0, 0 = e°_(j) and for all a in I(—h , 0) 

r° - 

(. L<j>){a) = (£e°_0)(-a) = L0_ a = L0 + / ( LDg 0)(0) dB. 

J Ct 

Hence Ltp £ W 1,p (—h, 0; K") and DLcj) = — LDqb. Moreover by Lemma 3.5, 
W 1,p (—h, 0; R”) C K(—h, 0;R") and from Lemma 4.3 0 £ K(—h, 0;R") and 
0(0) = 0 imply that (L0)( 0) = L0 and (L0)(— h) =0. □ 

4.7 The companion structural operator G of F 

We have seen in Theorem 4.3 how the adjoint semigroups {S T *(t)} and 


{S 1 *^)} are related to the solution of systems 

x(t) = (£e° x)(t) + (e+ h £, 1 )(-t), t > 0, x(0) = £°, (4.80) 

z(t) = (C T e° + z)(t) + (e+ h C){-t), t>0, z(0) = <°. (4-81) 

More precisely 

S T *(m = F{x{t), (e° *),) + (0, r{t)e), (4.82) 

S*{t )C = F * ( z(t ), (e° + z) t ) + (0, t^K 1 ). (4.83) 
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When h is finite and t > h, the second term in (4.82) and (4.83) is zero and 
by the intertwining theorem 

S r *m = S T *(t-h)S T *(h)d = S T *{t - h)F(x{h),x k ) 

= FS(t - h)(x(h),x h ), (4.84) 

S*(t) C = S*(t- h)S*(h)( = S*(t — h)F*(z(h),z h ) 

= F*S T (t — h)(z(h), z h ). (4.85) 

For t > h the structure of S T *(t ) and S*(t) considerably simplifies provided 
we have a knowledge of the pairs 

G£ = (x(h), x h ), G T C = (z(h), z h ), (4.86) 

which define continuous linear operators on M p and M q , respectively. They 
are related to F and F* because for £ = F<p or ( = F*ijj, we obtain 

{S{h)4>=(x(h),x h )=GF<l>, 

\S T {h)^ = {z{h),z h ) = G T F*rP, ’ 

and 

S(h) = GF , S T (h) = G t F*. (4.88) 

We shall see that G* = G T and that G and G T are intertwining operators 
similar to F and F*. They will play a complementary role to F and F* in 
the characterization of the F’-controllability and the F-observability for delay 
systems. 

Definition 4.4. The operators G and G T will be referred to as the companion 
structural operators of F and F*, respectively. □ 

The operator G was introduced by A. Manitius [6]. It will not be used 
in this chapter, but it has played an important role in conjunction with the 
operator F especially for the characterization of the notions of controllability 
and observability. 

Theorem 4.7. Let h, 0 < h < oo, p, 1 < p < oo, and q, 1 < q < oo, be real 
numbers: 

(i) The operators 

z* G£= (x{h),x h ): M p -► M p , (4.89) 

( i-> G r ( = (z(h), z h ): M q —> M q (4.90) 

are linear and continuous and 


GF = S(h), G T F* = S T (h). 


(4.91) 
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(ii) The operators G and G T define isomorphisms 

G: M p -> D(A), G t : M q -► D(A r ) (4.92) 

when D(A) and D(A T ) are endowed with their respective graph norm 
topologies. 

(iii) For p, 1 < p < oo, and its conjugate q, g -1 + p^ 1 = 1, 

G* = G t (4.93) 

when the elements of (M p )* are identified with those of M q . 

Proof, (i) By construction and the remarks preceding the theorem. 

(ii) We only prove this result for G. The map G is injective because G£ = 0 
implies that 

(x{h),Xh) = 0 =4- x(t) =0, 0 < t < h 

and by substituting in (4.80) 

^(-t) = 0, 0 <t <h, £° = 0 => £ = 0. 

It is surjective because for any if in D(A) 

if 1 G W hp {-h, 0; R") and if 0 = ^(0) 
and we can define the function x in IT 1,p (0, h; K 11 ) 
x(t) = if{t — h), 0 < t < h 

and the element <p = (cf 0 ,^ 1 ) of M p 

^(—t) = x{t) — ( Ce° + x)(t ), 0 <t < h, (j)° = x(0). 

By definition of G 

Gcf = (x(h),x h ) = (ip 1 (0),ip 1 ) = if. 

The continuity of G from M p to D(A) follows from inequality (4.7) in Theo¬ 
rem 4.1 (i). 

(iii) To establish (4.93) we use identity (4.35) in Lemma 4.2 with T = h 


nh nh 

/ z(h-t)-(x—£e+x)(t)dt+z(h)-x( 0)= / (x-£e+z)(h—t)-x(t)dt+z(Q)-x(h). 
Jo Jo 


By substitution of (4.80) and (4.81) 


nh nh 

/ z(h-t)-(e+ h t; 1 )(—t)dt + z(h)-t; 0 = / (e+ h <j 1 )(—t)-x(h — t)dt + <j°-x(h) 
Jo Jo 


and by changing the variable t to a = — t 

pO nO 


/ U n U 

Zh(oi) • ^(a) da + z(h) • £° = / C 1 ( a ) * %h(oi) da + C 1 • x{h). 

-h J-h 


'—h J—h 

This completes the proof of the theorem. 


□ 
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The last theorem is the intertwining theorem for G, S'* and S. 

Theorem 4.8 (Intertwining). Let h, 0 < h < oo, p, 1 < p < oo, q, 

p- 1 + q^ 1 = 1, be real numbers. Then the following properties hold and are 
equivalent : 

(i) S(t.)G = GS T *(t), Vf > 0. 

(ii) GD(A r *) c D(A) and GA T *£ = AGf, G D{A T *). 

(iii) For all A in the resolvent set of A T * 

R(X, A)G£ = GR(X, A T *)C, G M p . (4.94) 

Proof It is sufficient to establish (i). The equivalence of (i), (ii), and (iii) is a 
consequence of Lemma 4.4. Notice that for t > 0 

(x(t + h), x t+ h ) = S(t)(x(h), x h ) = S(t)Gf 

and 

(z(t + h), z t+ h) = S r (t)(z(h),Zh) = S T (t)G T (. 

Now substitute in identity (4.35) in Lemma 4.2 the solutions x and 2 of (4.80) 
and (4.81) for T = t + h: 

t-\-h 

z(t + h — s) ■ (ef h f 1 )(—s)ds + z(t + h ) • x(0) 

t-\-h 

(ef h ( 1 )(—s) ■ x(t + h — s)ds + 2 ( 0 ) • x(t + h). 

Notice that the integrands are zero for s > h and change the variable s to 
a = —s: 



f z(t + h + a) ■ ^(a) da + z(t + h) • £° 

J-h 

f 0 

= / G(a) ■ x(t + h + a) da + G ■ x(t + h). 

J-h 


Therefore 


and (i) is verified. 


(S'(t)G'C,0 = (C,S(t)GO 


□ 


Corollary 4.3. Assume that the hypotheses of Theorem 4.8 are verified. Then 
the following properties are verified and are equivalent : 

(i) S T (t)G T = G T S*(t), t> 0. 

(ii) G t D(A*) c D(A t ) and G T A*£ = A T G T £, G D(A*). 

(iii) For all X in the resolvent set of A* 

R(X, A t )G t £, = G t R( A, A*)£, VC G M q . 


(4.95) 
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Remark 4.6. Both G and G T have continuous linear inverse G 1 : D{A) —> 
M p and (G T ) -1 : D(A T ) —> M q . So in view of Theorem 4.8 and its corollary 

S T *(t) = G~ 1 S(t)G, S*{t) = (G r )~ 1 S T {t)G T 

and the adjoint semigroups are completely characterized in terms of {5(f)} 
and {S T (f)|. □ 


5 State space theory of linear control systems 

The basic concepts and techniques to deal with linear delay systems have been 
introduced in §3 and §4. In this section a control vector u(t) £ K m (m > 1, 
an integer) is introduced in the system dynamics through a delay operator B , 
which is a continuous linear map 


B: K{—h, 0; R m ) -► R” 
similar to the continuous linear map 

L : K(-h,0;R n ) -► E" 

of §3 and §4. 

Consider the linear control system 

ix(t) = Lx t + Bu t + f{t), t> 0, 

((a;(0), xo,uq) = (</>°, (j) 1 , w) £ M p x L p (—h , 0; R m ) 


(5.1) 


(5.2) 


(5.3) 


for the real number p, 1 < p < oo, and f £ Lf oc (0, oo; E"). The objective 
is to construct a state and give a state space formulation of equations (5.3) 
where delays in both variables x and u disappear. The motivation behind this 
objective is to put (5.3) in the form of an evolution equation in an infinite 
dimensional Banach space without delays to bring such systems in line with 
the standard Control Theory of infinite dimensional evolution systems. 

The two constructions that will be considered here were originally intro¬ 
duced by R. B. Vinter and R. H. Kwong [1] and A. Ichikawa [3]. In the 
light of §3.4 they correspond to the states 


and 


x(t) = F(x(t), x t ) 


x(t) = (x(t),x t ) 


(5.4) 


(5.5) 


as defined in (4.51) (Theorem 4.4 and (4.12)). They will require the introduc¬ 
tion of new semigroups that are extensions or generalizations of the semigroups 
{S T *{t)} and {S(t)} of §3.4, and the analogs for B of the structural operators 
L and L T for L. 
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All results established for L (Theorem 3.3, Lemmas 4.2, 4.3, 4.4, 4.5, and 
4.6) extend to B. So they will not be repeated here. We simply introduce the 
appropriate notation associated with B. There exists an n x m matrix (3 of 
regular Borel measures such that 

Bw — f dg 0w(O), Vw G K (—h, 0;R m ). (5-6) 

J-h 

For each T > 0, the continuous linear map 


I B:LP(-h,T;R m )^LP(0,T-R n ), 

\{Bv)(t) = Bv t , Vi > 0, Vu G C c (-h,T-R m ) 

has the same properties as C. Denote by (3 T the transposed of the matrix (3 
and introduce the continuous linear map 

,° 

ct ) ^B T <t>= dg/3 T (l)(9): K(-h, 0;R n ) -> R m . (5.8) 

J-h 

For q , 1 < q < oo, and all T > 0, we also have the continuous linear map 


B T : L«(-/i,T;R") L9(0,T;M m ), 

(tB T z)(t ) = B T z t , Vi > 0, Vz G C c (-h,T-R n ). 


Finally we associate with B and B T the structural operators 

(B: L p (~h , 0; R m ) L p {-h , 0; IT), 

[(Bw)(a) = (Be*Jw)(—a), a G/(— h, 0), 

(B r : L*{-h, 0; R") L*(-h, 0; R m ), 

| {B T = (B T a), a G I(—h, 0). 

When 1 < p < oo and q is the conjugate of p, p -1 + g -1 = 1 

B* = B r , 

where the elements of (L p )' are identified with those of L q . 


(5.10) 

(5.11) 


(5.12) 


5.1 The structural state 

The first step is to rewrite system (5.3) in the more accurate form 


x = Cx + Bu + /, 

(x(0),a;o,uo) = (</>°,^ 1 ,w) G M p x L p {—h, 0; R m ). 


(5.13) 
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Then separate the solution x(t), t > 0 and the control u(t), t > 0, from the 
pieces of initial functions (jr and w: 

x = Ce°,x + Be°,u + Ce° cj) 1 + Be 0 w + f, 

n (5-14) 

x(0) = <jP. 

As in §4.4 notice that system (5.14) does not directly use the initial functions 
4> l and iv but only the sum of their images Ce'fcj) 1 + Be_w. When h is finite 


(Ce°_ </> 1 )(t) + ( Be°_w)(t ) =0, t > h (5.15) 

and it is sufficient to consider the effect of the initial functions on the interval 
[0, h\. We recognize the structural operators L and B extended by 0 for t > h: 

(Ce°_4> X ){t) + (Be°_w)(t) = + Bw))(—t), t > 0. (5.16) 

So the true initial condition to system (5.13) is the pair 

{<!) O ,L(t) 1 +Bw)=F(j>+(0,Bw) (5.17) 

and this suggests the introduction of the following state: 

x(t) = ( x(t ), Lx t + Bu t ) = F(x(t), x t ) + (0, Bu t ) (5.18) 


at time t> 0. Compare (5.18) to (4.51) in Theorem 4.3 or to the intertwining 
identity in Theorem 4.4 between {S' T *(t)} and {5(t)}. It is clear that the 
state (5.18) is related to a nonhomogeneous version of the evolution equation 
associated with the semigroup {5 T *(f)}. So we are led to the embedding of 
the initial system (5.14) into the following larger family of systems: 

(x(t) = (Ce° + x)(t) + (Be° + u){t) + (e+^ 1 )(-t) + f(t), t > 0, 
wo)=£°, z=(e,e)£Mv, (5.i9) 

[f G Af oc (0,oo;R”), u G if oc (0,oo;R m ). 

Definition 5.1. The structural state x(t) at time t > 0 is defined by 

x(t) = {x{t),L{e° + x) t + B(e° + u) t + r(t)^ 1 ), (5.20) 

where r(t) is the right translation operator defined in (4.53) of Theorem 4.3 

[r(t)u](0) = (e+ h u)(9 — t), 0 £ I(—h, 0) (5-21) 

for any arbitrary function u defined on I(—h, 0). If = Lcj) 1 + Bw , then the 
definition (5.20) reduces to (5.18). □ 

Other terminologies have been used: the Vinter-Kwong state in 
M. C. Delfour [14] or the forcing function state in G. Grippenberg, 
S. O. Londen, and O. Staffans [1], 

It turns out that the state x(t) is the solution of a nonhomogeneous dif¬ 
ferential equation that need to be interpreted in an appropriate weak sense. 
In the process all delays will disappear and the equation will take the same 
form as its finite dimensional analog. 
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Notation 5.1. The restriction of the continuous linear operator 

B r : K(—h, 0; R n ) -> R m 

to D(A t ) is well defined because W 1,q (—h, 0; R") is continuously embedded 
into K(—h, 0; R”) (cf. Lemma 3.5. Its restriction to D(A J ) 

ip = (ip(0),ip) h-> B T ip: D{A t ) -> R m (5.22) 

will also be denoted B T . □ 

Theorem 5.1. Let the real number p, 1 < p < oo, and its conjugate q, g _1 + 
p~ x = 1, be given. Assume that x in W^(0, oo; R' 1 ) is the solution of system 
(5.19) for £ £ M p , f £ L^ oc (0, oo; R") and u £ Lf oc (0, oo; R m ), and let x(t) be 
the structural state constructed from x in (5.20)-(5.21): 

(i) For all ip in D(A J ) and t > 0 


(ip,x(t)) = (S T (t)ip,0 + f [B t S t (t - r)ip ■ u(r) 

Jo 

+ (S T (t-s)ip,(f(s),0))]dr. (5.23) 

(ii) The structural state x(t) is a solution of the weak equation: For all t > 0 
and all ip £ D(A T ) 

x(t)) = (A T ip, x(t)) + B T ip ■ u(t ) + ip( 0) • f(t), ^ ^ 

k ®(0) =t 

(iii) For each T > 0, the state x is the unique solution in 

V(0, T ; M p , D(A T )') 

= (z£C( 0,T-,MP): j t j*z£L p (0,T;D(A T y)\ (5.25) 


to the following equation: 

| J t j*x{t) = ( A T yx(t) + ( B T )*u(t ) + r(/(*), 0), t > 0, 


(5.26) 


where j *, (A T )*, and ( B r )* are the dual maps of the continuous linear 
operators 

j: D(A T ) -> M q , A t : D(A T ) -> M q , and B T : D(A T ) -> R m (5.27) 
defined on D(A T ) (cf. Notation 4.2, Definition 4.2, Notation 5.1). 
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Remark 5.1. In their original work, R. B. Vinter and R. H. Kwong [1] 
considered a delay operator B of the form 

Bw = B 0 w{0)+ [ B 1 (9)w(9)d9 (5.28) 

J-h 

for n x m matrices Bq and Bi(9), where the elements of Bi belong to 
L p (—h, 0;R) and a finite memory h. In this case 

,o 

B T ip = Bjip( 0)+ / B 1 {9) r y{9)d9 (5.29) 

J-h 


and both B and B T can be considered as linear maps on R m x L p {—h , 0; R m ) 
and = E" x L q (-h, 0; R") 


B(w 0 , wi) = B 0 w 0 + [ Bi(9)wi{9) d9, 
J-h 
f° 

B r (ip°, i/j 1 ) = Bq + / Bj{9)ip 1 {9)d9. 

J-h 


(5.30) 


This of course is the limit case where everything stays in the state space M q 
and equation (5.23) reduces to 

x(t) = + r S T *(t - r)[(B T )*u(r) + (/(r), 0)] dr (5.31) 

Jo 

because B T * : R m —> M p is now linear and continuous. The weak formulations 
(5.23), (5.24), and (5.26) were introduced by M. C. Delfour [15] to study 
the corresponding Riccati equation. They were absolutely necessary to handle 
control operators with pure delays. □ 


Remark 5.2. Notice that the underlying semigroup is the adjoint of the trans¬ 
posed semigroup associated with L. A careful interpretation of the proof of 
Theorem 5.1 indicates that the structural state is really the resulting product 
of transposition techniques applied to the differential equation (5.19). The 
elements entering into the structural state are obtained by isolating on one 
side the transposed semigroup associated with the transposed system. □ 

Proof of Theorem 5.1. In view of the linearity of system (5.19) and of the 
definition of the semigroup {/S' T *(t)} in Theorem 4.3, it is sufficient to establish 
identity (5.23) for £ = 0. Again the key tool is the integration by part formula 
(4.35) in Lemma 4.2 for T = t 


f z(t — s) ■ [x — Ce° + x]{s) ds + z(t) ■ x(0) 

Jo 

= f [z — C T e° i _z](s) ■ x(t — s) ds + z(0) ■ x(t), (5.32) 

Jo 
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where x is the solution of 


x = Ce° + x + Be° + u + /, x(0) = 0 


(5.33) 


and z is the solution of 


z = C 1 2 + C 1 e°_ip, z(0)=ip(0), ip € D(A ). (5.34) 

By techniques analogous to the ones used in the proof of Lemma 4.2 we can 
also show that for u in Lf oc (0, oo; R m ) 

f z(t — s) ■ (Be+u)(s) ds = f (B T e+z)(t — s) ■ u(s)ds. (5.35) 

Jo Jo 

Substract (5.35) from (5.32) and use (5.33) and (5.34): 

[ z(t- s) ■ f(s)ds 
Jo 

= f [(£ T e° ip)(s) ■ x(t — s) — (B T e+z)(t — s) • u(s)] ds + ip(0) ■ x(t) 

Jo 

and the right-hand side becomes 

f [(C T e^_ip)(s) ■ x(t — s) + (B T e°_ip)(s) ■ u(t — s)] ds + ^(0) • x(t) 

Jo 

= I [z(t — s) • /(a) + {B 1 e° + z)(t — s) ■ u(s ) + [B r e°_t/>)(s) • u(t — a)] ds. 
Jo 


/ 0 

But this can be rewritten as 
rO 


J — h 

and as 

we have 


\{L ip)(a) ■ (e+x) t (a) + {B ip)(a) ■ (e“ u)t(a)] da 


+ ip(0)-x(t)= ( z(t — s) ■ f(s) + (£> t z){t — s) ■ u(s) ds, 

Jo 


S T (r)ip = (z(r),z r ) € D(A t ), 


(B r z)(t - s) = B T z t - s = B T S T (t - s)ip, 

when B t is viewed as a continuous linear operator from D{A J ) into K m . So 
finally as L T = L*, ( L T )* = L and B T = B* and {B T )* = B 

((V’(O), ip, (x{t),L{e\x) t + B(e° + u) t )) 

= [ [(S T (t-s)ip,(0,f(s)))+B r S T (t-s)ip-u(s)]ds. 

Jo 
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The left-hand side of the above expression is precisely (if>, x(t)) for £ = 0 and 
this completes the proof of part (i). 

(ii) The differential equation (5.24) is obtained by differentiating (5.23) 
using the fact that for all T > 0 

z(-) = S T (-)ip G C°(0,T-,D(A t )) nC 1 {Q,T-M q ). 

For instance if ip G T>(]0,T[, T > 0, the distributional derivative of the term 

F(t) = [ z(t- s) • f{s)ds 
J 0 

is given by the expression 


Io L Z ^~ ^ -f( s ) dsdt 

= Jo ’ Is dt ~^t^ z(yt _ S ' ) 

= Jo ds f^' J s s> > + < ' 9 ( s M°) 

= J <p{t) J ds^(t-s)- f(s) + 2 ( 0 ) • f(t) 


and 


(j T? f'^dz 

■ W {t)= J q -(t-s)-f(s)ds + z(0)-f(t) 

= [ (S r (t-s)A T ip, (f(s),0))ds + ip(0)-f(t). 

Jo 

We repeat the above computation for the term in u but with ip G Z?((^4 T ) 2 ), 
and the sum of the derivatives of the right-hand side of (5.23) for ip in 
D((A t ) 2 ) is equal to 


(S r (t)A r ip,^) + [ (S T (t — s)A T ip, (f(s), 0)) ds 
Jo 

+ ip(0) ■ f(t) + f B r S t (t — s)A r ip ■ u(s) ds + B T ip ■ u(t) 

Jo 

= (A T ip, x(t)) + B 1 ip ■ u(t) + ip( 0) • f(t). 

So we obtain (5.24) for ip G D((A t ) 2 ) and this identity extends by linearity, 
continuity, and density of D((A t ) 2 ) in D(A t ) to all elements ip of D(A J ). 

(iii) From (5.23) x G C(0,T- M p ) and from (5.24) we obtain expression 
(5.26) and pjpj*z G L p (0, T; D(A J )'). The last element to complete the proof 
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is the uniqueness. By linearity it is sufficient to prove that for £ = 0, / = 0, 
and u = 0 the solution x in V(0, T; M p , D(A T )') to 

4 -fxit ) = (A T )*f(t), 5(0) = 0, 

at 

is zero. Fix t' , 0 < t! < T, and construct the function 

g(t) = (S T (t' -t)ip,x(t)), 0 <t<t', 

for ip G D(A J ). Then S T (-)ip G C ,1 (0,t'; M q ) n C(0,t'; D{A J )) and hence 
g € IT 1,p (0, t'; R). Moreover g(0) = 0 and 

4W = ~{A T S r (l/ - t)lp,x(t)) M «xMP 
at 

+ {S T (t' - t)lp, (A T )*x(t)) D ( A T) xD ( A Ty = 0. 

Then 

0 = 5(0) = g(t') = (i>,x(t')) 

and because this is true for all ip in D(A T ), x(t') = 0, Vt' > 0. This completes 
the proof of the theorem. □ 

5.2 The extended state 

In this section we come back to system (5.13) and extend the definition of the 
first state x(t) = (x(t),x t ) introduced in §4.2 to 


x(t) = (x(t),x t ,u t ) G Z p , 

Z p R n x L P(_ h: 0 ; R") x L p (-h , 0; R m ). 


(5.36) 


So we increase the size of the state space by adding a third component. The 
following presentation is new and extends to general delay operators the orig¬ 
inal work of A. Ichikawa [1, 3]. 

Terminology 1. The extended state associated with L and B will be defined 
by (5.36) and denoted by x(t). 

5.2.1 The extended semigroup {S(t)} 

Because of this added feature we have to somehow extend the definition of the 
semigroup {5(f)}. For this purpose we introduce the homogeneous system 


| x(t) = (£e° x)(t) + (Ce^cp 1 )^) + (Be°_w)(t), 
\*(0) = <fP, ((p°, (p 1 ,w) G Z p 

and the following linear transformations {S(t): t > 0} of Z p : 


(5.37) 


S(t)((p°, </f>\w) = (x(t), x t , t> 0. 


(5.38) 
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Terminology 2. The semigroup S{t) will be called the extended semigroup as¬ 
sociated with L and B. 


This terminology is a little bit more descriptive than the Ichikawa semi¬ 
group used in M. C. Delfour [14]. We shall use in § 6 the extended semigroup 
associated with L T and C T , where C is an appropriate delay observation func¬ 
tional. This is a natural extension of the transposed semigroup of §4.3. 


Theorem 5.2. Let p, 1 < p < oo, be a real number, let x be the solu¬ 
tion of (5.37) in W[^(0, oo;M n ) corresponding to 1 ,w) G Z p , and let 
S{t){(f >°, (p 1 ,w) be given by (5.38): 

(i) The family {S(t ): t > 0} forms a strongly continuous semigroup of con¬ 
tinuous linear transformations of Z p . 

(ii) The infinitesimal generator A of {S(t)} is given by 

A{p°, (f 1 , w) = (Lp 1 + Bw, Dp 1 ,Dw), (5.39) 


where 


i^A 1 ) e D(A) 

D(A) = { {p°A\w) G Z p : w GW hp {-h,0;R m ) 

w(0) = 0 


(5.40) 


(iii) For p, 1 < p < oo, and its conjugate q, q 1 + p 1 = 1, the adjoint 
semigroup {£*(£)} is characterized by 


S*m°,e,e) = (z(t),L T (e° + z) t + r(t)£\ B T {e° + z) t + r(t)£ 2 ), (5.41) 


where z is the solution of system 

Iz{t) = {£7e\z){t) + {e- + h e){-t ), 

U(o) = €°- 


(5.42) 


Its infinitesimal generator is given by the map 


C = (iP(o),L T ip + c,B T ip + \) 

i-» A*f = ( L T ip + C(0), L 1 Dip - DC, B T Dip - D\), (5.43) 


which is independent of the choice of the representation of the element £ 
in the domain of A*, 


D{A*)= <U: 


C = (m, L r if + C, B T ij + A) ' 
G D(A r ) 

C G W 1 , 9 (—h, 0; R"), C{—hf = 0 
A G W hq {- /i,0;M m ), X(—h) = 0, 


(5.44) 


in terms of {ip, A). 
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Proof, (i) The state x(t) = S(t)(cp 0 , (p 1 , w) is well defined because 

(£e° ^(i) = (e^L^X-t), (Be°_w)(t) = (e~ h Bw)(-t), 

and by Theorem 4.1 (i) there exists a constant c(T) > 0 such that for all 
T > 0 

Ill'llW 1,p (0,T;]R n ) < C(7 1 )[|0°I + ||L^ 2 ||lp + ||Bw||lp] (5.45) 

and t i—> (e°_w)t is the shift operator for the function e_w. It is linear and 
continuous by inequality (5.45). The semigroup property is obvious and the 
continuity with respect to t follows by continuity of x for t > 0 and the 
continuity of the shift operator 1 1 —> Xt , 1 1 —> ( e_w)t for L p -functions. 

(ii) Assume that (<p°, (p 1 , w) G D(A). Then for all T > 0 

X&C 1 (0, T; M p ) n (7(0, T; D(A)). 


In particular 


x G C 1 (0,T;R”), x. G C 1 (0, T; L p (—h, 0; R”)), 
(e°_w). G L p (—h, 0; R m ). 


By Lemma 4.1 (ii) 

x G W l ' p (-h, T; R”), (e°_w) G W^i-h, T; R m ) (5.46) 

and 

D t u t = Dg u t , D t (e°_w) t = Dg (e°_w) t . (5-47) 

As a result 

(p 1 = x \i(-h,o) G W 1,p (—/i, 0;R"X 
^(O) = a-(o) = <t>° => (< p°,(p 1 ) e D(A t ). 

Therefore we have established that any (<p°, cp 1 , w) G D(A) verifies 

{4>°,4> x ) G D(A t ), w eW^i-h, 0;R m ), w( 0)=0. (5.48) 

Finally because (5.46) is true, by Lemma 4.2 (ii) 

x. G C(0, T; W hp (-h, 0; R")), (e°_w). G (7(0, T; W^-h, 0; R m )) 

and 

= Lx t + B(e°_w) t 
at 

has a continuous right-hand side. The same is true of the right-hand sides in 
(5.47) and 
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A(4,°,4,\w) = jim (§<<).|*‘4 (e “"’ ) *) 

= ( Lq i 1 + Bw, D^jDw). 

Conversely if (</>°, (j) 1 , w) verify (5.48), then, for all T > 0, e°_w 

G and by Theorem 4.1 (ii), x G W 1 ’ p (—h,T;R n ). By 

Lemma 4.1 (ii) 

x, G C'(0,T;W 1 > p (-/i,0;R n )) 

and 

(e°_w), G C(0, T; W 1,p (—h, 0; M m )). 

Thus 

x(t) = Lx t + B(e°_w) t 

has a continuous right-hand side and x G (7(0,T;R"). Always by Lemma 4.1 (ii) 
x. G C 1 (0, T ; L p (—h, 0; M n )), (e°_w). G C 1 (0, T; L p (-h, 0; R" 1 )) 


and necessarily 




d d ox 
—Xt, — (e w)t 
dt 1 dV ~ ’ 


exists and is continuous for t > 0. So the limit as t goes to zero exists and by 
definition (</>°, (j ) 1 , w) G D(A). 

(iii) Again we use the integration by parts formula (4.35) in Lemma 4.2 
for the solution x of (5.37) and the solution z of (5.42) with T = t: 


j z(t — s) ■ [x — Ce° + x\(s) ds + z{t) ■ x(0) 

Jo 

= / (z — C T e° + z)(t) ■ x(t — s) ds + z(0) • x(t). 
Jo 


By substitution 


f z(t — s ) • [{Ce°_ </> 1 )(— s) + (Be°_w)(— s)] ds + z{t) ■ (j>° 

Jo 

= f {e+ h £, 1 )(~s) ■ x(t - s) ds + £° • x(t) 
Jo 


and 


l~h 


(e_J _z) t (a)-[Lcj) 1 + Bw](a) da+z(t)-cjr = 


> — h 


^(a)* (e^_x)t(o;) da+£°-x(t) 


or in a more compact form 

((C 0 ^ 1 ), (x(t), {e\x)t)) = z(t) ■ + (L T {e° + z) t ,(l) 1 ) + (B T (e° + z) tl w). (5.49) 
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To complete the above identity, we add the terms 

(£ 2 , (e°_w) t ) and (£\ (e° ^) t ) 

and use the identity 

(£ 2 , (e°_w) t ) = f £ 2 (ct) • (e°_w)(t + a) da = f £ 2 (9 — t) ■ (e°_w)(0) dO, 

J-h Jt.-h 

(£ 2 , (e°_w) t ) = f {e+ h (; 2 )(6 — t) ■ w{9) d8 = (r(t)£ 2 , w), (5.50) 

J-h 

and similarly 

= (5.51) 

Combining (5.49), (5.50), and (5.51) we obtain 

((e,e,eux(t),x u (e°_w) t )) 

= ((z{t),L(e° + z) t + r(f)£\ B T (e° + z) t + r(f)£ 2 ), (<j)°, 0 1 , w)) 

and henceforth the adjoint semigroup expression (5.41). 

We now turn to the characterization of the infinitesimal generator A*. It 
is readily seen that S* has a special structure 

= (s*m°,e),B(e° + z) t +T(t)e), ( 5 . 52 ) 

s*m = + (( 0 , 0 ), B( e ° *)*+ rm 2 ) , ( 5 . 53 ) 

where the first two components that are related to S* can be separated from 
the third component. So if £ G D(A*), then (£ 0 ,£ 1 ) G D(A*) and by Theo¬ 
rem 4.5 

3ip G D(A r ), (that is ip = (-0(0), ip), ip G W^i-h, 0; R ra )) 

and 

3CG W 1>9 (-/i,0;R n ) 

such that 

(0,0) = F*ip + (0, C) = (0(0), L T ip + C) (5.54) 

and 

^^*(^(^ 0 , ^ 1 ) = A*[F*ip + (0, £)] = F*A T ip + (C(0), —-DC) 

= {L T iP + ((0),L T D-iP ~ D(). (5.55) 

But in view of the decomposition (5.54), equation (5.42) reduces to 

(z(t) = (£ T e»z)(f) + (e; fc [i^ + C])(-f), 

\ =(C r zm + (e+ h ()(-t), 

U(°) = 0(0), z 0 =ip. 


(5.56) 
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By Theorem 4.1 (ii), for all T > 0, z G W 1,q (—h,T;R. n ) and by Lemma 4.1 (ii) 
0 . G C(0, T; W 1,q (—h, 0; R")) n C 1 (0, T; L q (-h, 0; R n )) (5.57) 

and 

D t B r zt = B T D g zt. (5.58) 

Now go back to the third component of S*(t)£, in (5.53) 

F(t) = B T {e° + z) t + r(f)£ 2 = B T z t + r(t )£ 2 - B T (e°_ </>)* 
and recall that by Lemma 4.4 applied to B T 

B T (e°_iP) t = T(t)[B T i>}. 

Then 

F(t) = B T z t + r(t)A, A = £ 2 - B T ip. 

From (5.57) t i-» B r z t belong to C 1 (0, T; L q (—h, 0; M ra )) and from (5.57)- 
(5.58), 

B t z. G C(0, T; W^i-h, 0; R")) n C 1 (0, T; L q (-h, 0; R")) (5.59) 

and 

j f B T z t = B T D 9 z t . (5.60) 

So the assumption £ G D(A*) implies that 

t(-)A G C 1 (0, T ; L q (—h, 0; R m )). (5.61) 

But this is the shift operator for the function eg A in L q {— oo,0;R m ) and by 
the analog of Lemma 4.1 (ii) 

e^ h \ G W 1,9 (—oo, 0; R m ) => A G W 1>q (-h, 0; R m ), A (-ft) = 0, 

and 

^r(f)A = —T(t)Dg A (5.62) 

as in the proof of Theorem 4.5. Finally 
dF 

— (f) = B T Dg z t — r(t)Dg A. (5.63) 

To summarize we have shown that if £ = (£°, £ 1 , £ 2 ) G D(A*) 


e=m, e=L r ip+c, e = 

il>, C G W 1,q (—h, 0; R"), C(-h) = 0, 

A G W 1,g (—h, 0; R m ), A(—ft) = 0. 


(5.64) 
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Moreover from (5.55), (5.60), and (5.62) as t goes to zero 

A*C = (L r iP + <(0), L T Dip - D(, B 1 Dip - DA). (5.65) 

Conversely if (5.64) is verified, then by Theorem 4.5 (i), (C 0 ,,^ 1 ) € D(A*) 
and <S*(-)(£°,C 1 ) belongs to C ll (0,T;M 9 ). Moreover (5.42) reduces to (5.56) 
and we have (5.57) and (5.59). Finally condition (5.64) on A implies that 
ejj^A £ W 1,9 (—oo,0;M m ) and we have (5.61). Therefore £(•)£ belong to 
C' 1 (0,T; Z q ) and necessarily £ £ D(A*). 

To complete the proof we must show that expression (5.65) for A*C is 
independent of the representation of £ in terms of (ip, C, A). By linearity this 
is equivalent to show that 

C=(m,L T iP + C,B T iP + X) = 0 

=> A*C = (L T ip + C(0), L 1 Dip - DC, B T Dip - DA) = 0. 

So C = 0 is equivalent to 

ip(0) = 0, ^^(-^O;®"), 

L T ip + c = o, C e^l-MiR”), C(—*) = o, 

B r ip + A = 0, A£ W 1 ’ q (-h,0-R m ), A(—ft) = 0. 

By Lemma 4.6 extended to L T and B T 

0 = D[L T ip + C] = -L T Dip + DC, 

0 = D[B r ip + A] = -B 1 Dip + DA, 

0=[Lip + C](0) = L T ip + C(0), 

and i*C = 0. 

5.2.2 The nonhomogeneous case with control 

Go back to system (5.13), which can be rewritten as 

x = Ce^x + Be° + u + Ce^cp 1 + Be°_w + /, 
a;(0) = (p°. 

Associate with the solution x of (5.66) the extended state 

x(t) = (x(t),x t ,u t ), t> 0. 

The objective is to obtain the analog of Theorem 5.1 for x(t). Here {5*(t)} 
will play the same role as {S T (t)} and it will be necessary to construct a 
control operator B T : D(A*) —> K. m , which will play for x(t) the same role as 
B T : D(A J ) —> R m for x(t). The results are presented in the next theorem 
followed by a short discussion and the proof. 


□ 

(5.66) 

(5.67) 
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Theorem 5.3. Let the real number p,l < p < oo, and its conjugate q , g _1 + 
p~ x = 1, be given. Denote by x in W l( j£(0, oo; R ra ) the solution of system (5.66) 
for (0°, (f 1 , w) € Z p , f € if oc (0, oo; R"), and u € Lf oc (0, oo; R m ), and let x(t) 
be the extended state constructed from x in (5.67): 

(i) For all p in D(A*) and t > 0 


(P,x{t)) = {S*(t)p,(<fr,<f> ,w)) + / [B S*{t- s)p-u(s) 

Jo 

+ S*(t-s)p- (f(s),0,0)]ds, (5.68) 

where 

p = (^(0), lAif + C, + A) ^ B T p = B t + A(0) 

: D(A*) -► K m (5.69) 

is a well-defined continuous linear operator on D{A*) endowed with its 
graph norm topology ( cf . (5.43) in Theorem 5.2 for the representation of 
elements of D(A*)). 

(ii) The extended state x(t) is the solution of the weak equation: For all t > 0 
and all p € D(A*) 


(5.70) 


^(p, x{t)) = (A*p, x(t)) + B T p ■ u(t) + p° ■ f(t), 

k *(0) = {(f,(jA,w). 

(iii) For each T > 0, the state x is the unique solution in 

V(0 ,T-Z p ,D{A*)') 


= (7(0, T; Z>): -i*y € L*( 0, T; D{A*)') \ (5.71) 


to the following equation in D(A*)': 

\ Jt ri{t) 

{ = (A*)*x(t) + (B r )*u(t) + i*(f{t), 0,0), * > 0, ( 5J2 ) 

U(0) = (c t•)°,<j> 1 ,w), 

where i: D(A*) —> M q is the canonical injection of D{A*) into M q and 
i *, (A*)* and ( B T )* are the dual maps of the continuous linear operators 

i: D(A*) —> Z q , A*: D{A*) -> Z q , B r : D{A*) -4 K m (5.73) 

defined on D(A*) endowed with its graph norm topology. 
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Remark 5.3. The key element of this theorem is the introduction of the op¬ 
erator B t , which makes it possible to complete and extend the work of 
A. Ichikawa [1, 3] who considered operators B of the form 

N |*0 

Bw = J2Biw(0i)+ / B 01 (6)w{6)dO, (5.74) 

i -0 •*~ h 

where N > 0 is an integer, 

-oo <-h = 0 N <■■■> 9 i+ 1 < 6i < ■ ■ ■ > 9 0 = 0 (5.75) 

are real, Bq 1 Bi, ..., Bn and Bq\(9) are n x m matrices, and the element of 
B 0 i{9) are L 9 -functions on I(—h, 0). In that case 

N ,0 

B T p = Y,BjiP(9 i )+ / B 01 (9) r ^(9)d9 + \(0) 

i—0 ~ h 

with the notation of (5.69). But the following limit exists: 

lim [B T ip\ (a) = B T — Bq ip( 0) 

a / 1 0 

and 

B T p = B^(0) + [B r iP + \}{0), (5.76) 

where we recognize the third component B' 1 ip + A of 

p = (V>(0), L T i; + C, B T ip + A) 

evaluated at 0. This construction and identity (5.76) can be extended to op¬ 
erators B of the form 

Bw = B o w(0)+ [ d 0 /3 !w(9), w G K(-h, 0; R m ), (5.77) 

J-h 

where Bq is an n x m matrix and (3\ is an n x m matrix of regular Borel 
measures such that 

lim / do |/3i| = 0. (5.78) 

v/o J a 

However this is a special case that does not generalize to arbitrary continuous 
linear maps B : K(—h, 0;M m ) —> R n because there is a priori no reason that 
the third component B T ip + X of p £ D/A*) be defined at the point 0. The dif¬ 
ficulties encountered in the construction (5.69) of operator B T are analogous 
to the ones encountered in the characterization of the infinitesimal generators 
A* of the adjoint semigroups {5 1 *)!)} in Theorem 4.5. □ 
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Proof of Theorem 5.3. (i) Let p € D{A*) be of the form 

P = (V’(O), L r ip + C, B T tjj + A), 

C,il> ew^i-h, o-,R n ), a-h) = 0 , 

A e W 1 ’ q (—h, A(—ft) = 0, 

and let 2 be the solution of the system 

m = (£ r e° + zm + (£ T e°-m) + K h o (-*), 

^(o) = V'(o)- 

This is the final form of (5.42) when p £ D{A*) is given by (5.79). By con¬ 
struction and the characterization of D{A*) given in Theorem 5.2 

S*(t)p = (z(t), L T z t + r{t) C, B T z t + r(t) A). (5.81) 

In view of the linearity of system (5.66) and of the definition of the semi¬ 
group {S(t)} in Theorem 5.2, it is sufficient to establish identity (5.68) for 
(0°, (f 1 , w) = 0. The first step is the use of the integration by parts formula 
(4.35) in Lemma 4.2 for T = t 


(5.79) 


(5.80) 


[ z(t — s) ■ [x — £e+;r](s) ds + z(t) ■ cc(0) 

Jo 

[z — C T e° + z\(s) ■ x(t — s)ds + z( 0) • x(t), (5.82) 

where x is the solution of 

x = Le° + x + Be° + u + /, x(0) = 0. (5.83) 



Moreover as in (4.35) 

f z(t — s) ■ (Be^_u)(s) ds = f (B T e+z)(t — s) ■ u(s) ds. (5.84) 

Jo Jo 

Substract (5.84) from (5.82) and use (5.80) and (5.83) 
z(t — s) ■ f(s) ds 

= f [(C T e°_ip)(s) + (e+ h C)(—s)] • x(t - s) + (B T e°_ip)( s ) • u(t - s)l ds 
Jo 

— f (B T z)(s) ■ u(t — s) ds + if(0) ■ x(t). 

Jo 


But this can be reorganized and written as follows: 
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V'(0) • x{t) + (L T ip + C, (e%x)t) + (B T ip, ( e° + u)t) 


10 

To complete the identity we add the term 

,o 


= [ [z(t - s) ■ f(s) + B t z t -s ■ u(s)]ds. (5.85) 
Jo 


(A ,{e° + u)t) = f A (a) ■ (e+u)(t + a) da 

J —h 

= f (e+ h \)(s — t) ■ (e+u)(s) ds 

J t—h 

= ( (ef h X)(s — t) ■ u(s) ds. 

Jo 


(5.86) 


Therefore from (5.79), (5.85), and (5.86) 


(p, x(t)) = f {z(t - s) • f(s) + [B T z t - s + (e + ,l A)(s - t)} ■ u{s)} ds. 

Jo 

But p € D(A*) and hence S*(t — s)p G D(A*) has the representation given in 
(5.81) with t — s in place of t. 

To complete the proof of the theorem, we need the following lemma, which 
will be proved at the end. □ 


Lemma 5.1. The linear operator 

p = (t/>(0), L T ip + C, B r ip + A) e-> B T p = B r ip + A(0): D{A*) R m (5.87) 

is well defined, linear, and continuous on D(A*) endowed with its graph norm 
topology ( cf. (5.43) in Theorem 5.2 for the representation of the elements of 
D(A*). 

So by definition of B T 

B T S* (t - s)p = B T (z(t - s),L T z t -s + r(t - s)(,B T z t - s + r{t - s) A) 

= B T z t - s + [r(t - s)A](0) = B 1 zts + (e+ ft A)(s - t ) 

and 

(p,x(t))= [ [(S*(t.-s)p,(f(s),0,0))+B T S*(t-s)p- u{s)]ds. 

Jo 

(ii) and (iii) now follow by the same techniques as in the proof of Theorem 5.1 
(ii) and (iii). 

Remark 5.4. Notice that B T p does not depend on the second component of 
p. So it readily extends to 

A € W 1 ' p (—h, 0;R m ), A(—ft) = 0 

‘ ip € W l p {-h, 0; R n ), p 2 G L q (-h, 0; K n ) 

□ 


(V’(O), P2, B r ip + A) 
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Proof of Lemma 5.1. The proof is very similar to the proof of Lemma 4.6 
with B t in place of L. By linearity the map (5.87) is well defined if 

(V’(O), L r if + C, B r tf + A) = 0 => B T if + A(0) = 0. 

But from Lemma 4.6 (ii) 

ip G W^i-h, 0; IT) and ^(0) = 0 => {B T ip){ 0) = B r ip. 

As a result B T ip + A G W 1,q (—h, 0; R") and 

B r ip + A = 0 => 0 = [B r ip + A](0) = B T ip + A(0). 


For the continuity we use the same techniques as in Lemma 4.6 (i): 

r° 

B r ip + A(0) = B T ip_ a + A(a) - / [B T D g ip - Dg A] (0) dd 

J QL 

and use the fact that 


B T ip- a + A (a) = (B r e°_ip)(—a) + A (a) + ( B r e° + ip(0))(-a) 

= [B T iP + X](a)+(B T e° + iP(0))(-a). 

Then by making the same estimates as in Lemma 4.6 (i), there exists c > 0 
such that 


I B T if + A(0)| < c[|V-(0)| + || B T iP + A||, + || B t DiP - DA||,]. 

But for p = (ip(0),L T ip + C,,B T ip + A) in D(A*) (cf. (5.43) in Theo¬ 
rem 5.2 (iii), 


II HI D(A‘) — II HI 9 + ll^*HI« — |V>(0)| + II L T 1p + Cllg + II B T 1p + A||, 

+ \L T ip + C(0)| + \\L T Dip - D(\\ q + \\B t DiP - £>A||, 

and hence 

\B T p\ = \B T iP + Xm<c\\p\\ Da ,y □ 


6 State space theory of linear control systems with 
observation 

In this last section we add to the linear control system 

(x = Lx t + B 0 u t + /(f), t> 0, 

1 (x(0),x 0 ,uo) = (< p°,<p 1 ,w) 


the observation equation 
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y(t) = Cx t + Biu t , t> 0 (6.2) 


for the continuous linear maps 


L: K(-h,0-,R n ) -> R™, 
C: K(—h, 0; R") -> R fc , 


B 0 : ->R n , 

B x : K(-h, 0;R m ) -^R fc 


(6.3) 


and integers n > 1, m > 1, and k > 1. 

The objective is to construct a state, a state equation, and an unbounded 
observation operator for the state. As in §3.5 two parallel approaches will be 
considered. The first one is based on the use of the extended state introduced 
in §5.2 

x(t) = (x(t),x t ,ut), t> 0, (6.4) 

and the observation operator 


(</>(0), (f>, w) i—> Ccj) + B\w: D(A) —> M fe . (6-5) 


The second one is due to D. Salamon [2] who added a third component to 
the structural state 


x(t) = (x(t),Lx t + B 0 u t , Cx t + Biut), (6.6) 

and an appropriate observation operator can be defined on the domain of 
the natural semigroup associated with the state x(t) and u(t). This will be 
referred to as the extended structural state in §6.2. 

In this section we give a presentation that naturally fits within the general 
framework adopted in this chapter. Moreover we show that the two states are 
not unrelated. They turn out to be also intertwined with respect to a general 
structural operator F, which contains all operators that characterize the delay 
structure of the system and the control and observation operators. This result 
is new, but the essential ideas and constructions were already contained in 
the general model developed by M. C. Delfour and J. Karrakchou [1, 
2]. All this can obviously be extended to more general delay structures. 

Formally in the first case the natural semigroup will be the extended semi¬ 
group {5(f)} associated with L and B 0 ■ The extended state x will be the 
solution of the state equation 

/ ±?x(t) = (Arm + (B T y U (t), 

|i(0) = (<f) 0 , (jAiW), 

and the observation will be given by 

y(t) = Cx(t), (6.8) 


where 
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B r : D(A*) ->R m , B T (0(O),Z T 0 + C,Z c J> + A) = H ( )> + A(O), (6.9) 

C: D(A) ->R fc , C{<f>(0),(f>,w)=C<l> + B 1 w. (6.10) 

In the second case the semigroup will be the adjoint {S T *(t)} of the ex¬ 
tended semigroup {S(f) T } associated with L T and C T . It is the analog of the 
extended semigroup associated with L and Bq in Terminology 2. The extended 
structural state x will be the solution of 

f j t rm = (A T )*x(t) + (B T )* U (t), (6 n) 

1 x(0) = (0(0), Z0 1 + B 0 w, Ccj) 1 + Biw). 


When Bi = 0 
where 


y(t) = Cx(t), 

B t : D(A t ) -> R m , 

S T (0( = B^ + Bj V, 

C: D{A t *) -> 

c(0( 0), Z0 + C, C(j> + A) = C0 + A(0). 


( 6 . 12 ) 

(6.13) 

(6.14) 


When B\ ^ 0, the situation is slightly more complex and y(t) depends on x(t) 
and u(t). 

Of course everything will be made more precise as we proceed, but we 
would like to already draw some general conclusions to guide the reader in 
the subsequent developments of this theory. In §3.5 the use of the structural 
state x(t) with two components had a clear advantage over the extended 
state x(t) with three components. Here both states have three components. 
The operators B T and C have the same structure as the operators C and B T . 
So there is a flavor of duality or intertwining between the two approaches, but 
no clear technical advantage in choosing one over the other. In both cases 
we come up with a classical evolution system and unbounded control and 
observation operators ... and most important no more delays. 

However from the System Theoretic viewpoint, the first approach leads to 
the observation y(t) as a linear function of the extended state x(t), whereas 
in the second approach it is a linear function of (x(t), u(t)). In other words in 
the first approach the state contains the control segment Ut. and the control 
does not explicitly appear in the observation equation, whereas in the second 
approach the observation equation explicitly contains the control u(t) at time 
t. 


6.1 The extended state 

This case is easy because we have already studied x in Theorem 5.3 for the 
system 
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\x = Ce\x + B a e\ u + Ce^cjA + B Q e°_w + /, 
l^x(O) = </>°. 

The observation (6.2) makes sense because 

y = Cx + Biu, (6.16) 


where, as in the case of L and C in Theorem 3.3, for all T > 0, we can associate 
with C the linear map 

C: L p (-h,T-R n ) -> L p (0,T;R fc ) 

{Cx)(t)=Cx u VxeC c (]-h,T[;R n ),te[0,T}, ? 

and linear maps Bq and B\ are similarly associated with Bq and B\, respec¬ 
tively. The operator 


(</>°, (j) 1 , w) i—> C (</>°, (f) 1 , w) = Ctf + B\w 

: R" x K(-h, 0; M”) x K(-h, 0; M m ) R fc (6.18) 

is linear and continuous. For initial conditions of the form 

(</>(O),0,u;), (f> € K(—h, 0; R”), weK(-h, 0;R m ) (6.19) 

and 

/€ Lf oc (0,o°;R”), u e Cioc(0, oo; R m ), u(0) = w(0), (6.20) 

we have a continuous observation y 

y(t) = Cx{t) = Cx t + Biu t , t > 0. (6-21) 

The operator C introduced in (6.18) can also be viewed as a continuous linear 
operator 

^=(0(O),0,w;)i->C , ^ = C0 + Biw;: £>(i)R fc , (6.22) 

when D(A) is endowed with the graph norm topology. When u(t) = 0, t > 0, 
and (4>(0), (f>,w)) £ D(A), 

Cx{t) = Cx t + Bi(e°_w)t- (6.23) 


6.2 The extended structural state 

This section is not necessarily more difficult than the other ones, but certainly 
heavier in notation. Yet the constructions and the proofs are very much the 
same as in the previous sections. Always as in Theorem 3.3 where we have 
associated with L, a matrix of regular Borel measures 77 , a new operator L T , 
maps C and C T , and structural operators L and Z T , we associate with C, Bo, 
f?i, the same items 
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L 

C 

V 

L r 

C T 

L 

L T 

C 

c 

7 

C r 

c r 

C 

C T 

Bo 

Bo 

0o 

Bj 

Bj 

Bo 

Bj 

B i 

Bi 

0i 

Bj 

Bj 

Bi 

Bj 


Of course the previous results for L will apply to C, Bq, and B\. Recall that 
the structural state was defined for the linear control system 


x(t) = (Ce° + x){t) + ( B 0 e° + u){t) + (e + h ^)(-t) + f(t), t > 0, 

x(0) = £° 


and that (6.15) is a special case of (6.25). The new state will be an extension 
of (5.20) by adding a third component. 

Definition 6.1. The extended structural state is denoted by x(t) and defined 
as 


x{t) = (x(t), L(e° i _x) t + B 0 (e\u) t + r(t)£\ C(e° x) t 

+ B 1 (e° + u) t + r(f)£ 2 ). (6.26) 

□ 

The observation equation will be for t > 0 

y(t) = (Ce° + x)(t) + (B ie ° u)(t) + (e^ 2 )(-i). (6.27) 

When 

£ = (£°,£ 2 ) = (0°, U 1 + B 0 w, Ccf 1 + B lW ), (6.28) 

we exactly recover system (6.15)-(6.16). 

6.2.1 The extended semigroup {S T (t)} associated 

Given the real number q, 1 < q < oo, consider the system 

r m = (c T zm + ( c T e°_ v m, t > o, 

\(z(0),zo,uo) = (V’°,V’V) G Z q 

and define the family of linear transformations 

S T (f)(V’°,'i/’ 1 ,n) = {e°_v) t ), t> 0. (6.30) 

It is clear from §5.2.1 that |<S T (t)} associated with L T and C T has the same 
structure as {5(f)} defined in (5.38) and that Theorem 5.2 applies with obvi¬ 
ous substitutions. The family |5' T (t)} is a strongly continuous semigroup of 
continuous linear transformations of Z q = R" x L q (—h, 0; R") x L q (—h, 0; R fc ). 
Its infinitesimal generator A T is given by 
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A T (t/>(0), ip, v) = ( L T ip + C T v, Dip, Dv ), (6.31) 

where 

r (mvo €D(a t ) ^ 

D(A t ) = l (iP( 0), ip, v) G Z q : v G W^i-h, 0; R fc ) > • (6.32) 

[ v(-h) = 0 j 

The canonical injection of D(A T ) into Z q will be denoted by j. For p, 1 < 
p < oo, and its conjugate q, q^ 1 +p _1 = 1 , the adjoint semigroup {S T *(t)} is 
characterized by 

S T *(t)(£°,£\£ 2 ) = (x(t),L(e° + x) t + T(t)£ 1 ,C(e° + x) t + r(f)£ 2 ), (6.33) 

where x is the solution of system 

x(t) = {Ce\x)(t) + (e^ h ^)(-t), t> 0, 
a:( 0 ) = £°. 

6.2.2 The case B ± — 0 

When Bi = 0, the observation equation (6.27) reduces to 
y(t) = (Ce° + x)(t) + (e~ h e)(-t), t> 0. 

For $ G D(A t *), 

Z = (m,L<p + <;,c<p + \), 

(PX&W^i-h, 0;R"), a~h)=0, 

A G W^i-h, 0; R k ), X(-h) = 0, 

and (6.25) reduces to 

x(t) = Lx t + {B 0 e\u)(t) + (e+ ft C) M) + 

(x( 0 ),x o ) = (cp(0),(p), 

y(t) = Cx t + (e+ h \){-t), t > 0. 

Always for £ G D(A T *) of the form (6.36) 

x{t) = (x(t), Lx t + B 0 (e° + u) t + r(t)C, Cx t + r(f)A) 
and because e+^A G W 1,p {— oo, 0; R fe ), [r(f)A](0) = (e+ h A)(— t) and 

y(t) = Cx t + (e+ h \)(-t) 

= Cx t + [r(t)A](0) = Cx(t). 


(6.34) 

(6.35) 

(6.36) 

(6.37) 

(6.38) 

(6.39) 


(6.40) 
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We recognize the operator 

£ = (0(0), Lf> + C, Cf> + A) Cf = C(t> + A(0) : D(A T *) -► R k , (6.41) 

which is the analog of the operator B T in Lemma 5.1 with L and C in place of 
L t and B T . So it is linear and continuous when D(A J *) is endowed with the 
graph norm topology. However recall from Remark 5.4 that it is independent of 
the second component of £, which can be arbitrarily chosen in L 2 {—h , 0; R^). 


6.2.3 The case B i yi 0 


Comparing (6.26) and (6.33) we recognize that they coincide for u(t) = 0, 
t > 0. The next theorem is the analog of Theorem 5.1. 

Theorem 6.1. Let the real number p, 1 < p < oo, and its conjugate q, g -1 + 
p- 1 = 1, be given. Assume that x in W lo ’,?(0, oo; R ra ) is the solution of system 
(6.25) for f € M p , f € Lf oc (0, oo; R") and u € Lj^ c (0, oo; R m ), and let x(t) be 
the extended structural state constructed from x in (6.26): 

(i) For all p in D{A J ) and all t > 0 


(p,x(t)) = (S T {t)p,£) + [ [B T S T (t-r)p-u(r) 

Jo 

+ ( S T (t - r)p, (/(r), 0, 0))] dr , (6.42) 

where 

p = (0(0), 0n) ^ B T p = B^ip + Bjv. D(A t ) -> K m (6.43) 

is linear and continuous on D(A J ) endowed with its graph norm topology. 

(ii) The state x(t) is the solution of the weak equation 


f ^{P, x(t)} = ( A T p , x(t)) + B T p ■ u(t) + p° ■ f(t), t > 0, 
|*(0)=£, Vp € D(A T ). 

(iii) For each T > 0, the state x is the unique solution in 


(6.44) 


V(0, T ; M p \ D(A t )') 

= 12 G C(0, T; M p ): ± fz € 1/(0, T; .D(i T )') j (6.45) 

to the following equation in D(A T )': 

[ = + (-B T )*«(i) + J*(/(*), 0,0), t > 0, 

}i(0) = £, 


(6.46) 
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where j is the canonical injection of D(A T ) into Z q and j*, and (A T )* 
and ( B t )* are the dual maps of the continuous linear operators 

J: D(A t ) -► Z q , A T : D(A t ) -► Z q , B T : D{A T ) -> M m (6.47) 

defined on D(A T ) endowed with the graph norm topology. 

Remark 6.1. The operator B T is similar to the operator C introduced in 
(6.22). It is the restriction to D(A T ) of the continuous linear operator 

(0°, 0 1 , v) ^ B T (if , 0 , if 1 , v ) = Bj i) 1 + Bjv 

: K" x K(—h, 0; E n ) x K(-h, 0; R k ) -> R m . (6.48) 

□ 

The proof of this theorem will be given at the end of this section. Before 
stating the next theorem, which describes the structure of the observation 
equation for smooth data, it is useful to consider the following simple example. 

Example 6.1. Consider the linear system without delays 

x(t) = Ax(t) + Boou(t), x(0) = x°, t> 0, (6.49) 

y(t) = Cox(t) + B±ou(t), t > 0. (6.50) 


Then 

L<f> = A<f>( 0), B 0 w = B oo w(0), C(f> = C 0 4>(0), B x w = B 10 w(0), 
and it is readily seen that 

L = 0, Bq = 0, (7 = 0, and Bi = 0. 

For initial conditions of the form 

£ = (0(0), Lf) + B 0 w, C4> + Biw) = (0(0), 0,0) 
the state reduces to 

x(t) = (x(t),0,0) 

and the observation y(t) given by (6.50) necessitates a knowledge of both x(t) 
and u(t). □ 

This example illustrates how the structural operators construct a state x(t) 
that is “minimal” in the sense that any artificial delay structure is removed 
or filtered out. It also clearly indicates that the observation y(t) at time t > 0 
necessitates a knowledge of both x(t ) and u(t). This fact is well known for 
finite dimensional systems of the type (6.49)-(6.50) without delays. 

Consider initial conditions of the form 
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£ + {0,B 0 w,Biw), 

where 

£g D(A t *) and w G W 1>p (—M;R m ); 
that is, there exist 

^(6^(-fc 1 0;n a-h) = 0, 

Ae W llP (-ft,0;M fe ), A(—ft) = 0 

such that 

£ = (#)),L0 + C,^ + A). 

For initial data of the form (6.51) and 

/GLf oc (0,oo;K"), 

W e< o ’ c p (0,oo;M m ), u(0)=u;(0), 

equation (6.25) reduces to 

f x(t) = Lx t + B 0 u t + (e+ h C)(-t) + f(t), t> 0, 
|(x(0),a:o,uo) = (<j>(0),<j),w), 

y(t) = Cx t + Biu t + (e+ h X )(-£), t > 0, 

and the state x(t) is given by 

(x(t), Lx t + B 0 u t + r(t)C, Cx t + Bi«t + r(t) A). 

By assumptions (6.51) to (6.55) the term 

(z(£), Lx t + r(t)C, + r(t)A) G £>(A T *), 
and by definition (6.41) of the observation operator C for all t > 0 
C(x(t), Lx t + r(t)C, Cx t + r(t) A) = (Art + (e+ h A)(-£). 

So to relate j/(t) and a:(t) we concentrate on the term 


(6.51) 

(6.52) 

(6.53) 

(6.54) 

(6.55) 

(6.56) 

(6.57) 

(6.58) 

(6.59) 

(6.60) 


(0,B o ut,Biu t ). (6.61) 

As shown in Example 6.1 this term is not rich enough to completely recon¬ 
struct the observation y(t) and deal with nondelayed terms in the variable u. 
To fully recover the observation y(t) we need the variable u(t). The situation 
is analogous to the one in (6.60) for the variable x, which makes sense because 
of the presence of the term x(t). The technical result behind this construction 
is Lemma 4.6 applied to B\\ For all w G W 1,p (—ft, 0; R m ), the map 


(w(0), B\w) i—> B\w 


(6.62) 
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is well defined, linear, and 

3c > 0, such that \/w G W 1,p (—h, 0;M m ), 

\B lW \ < c[|w(0)| + HBitoHp + \\BiDwWp]. 

So Lemma 4.6 has the following natural extension here. 

Lemma 6.1. Let p, 1 < p < oo, be a real number. For all £ in D(A T *) of the 
form (6.54)-(6.53) and w in W 1,p (—h, 0; R m ) the map 


(£ + (0, B 0 w, Biw ), io(0)) = ((^(0), Lcj) + B 0 w + C, C0 + B\w + A), u’(O)) 
Cext^d- (0, B 0 w,Biw),w(0)) = C(j> + B\w + A(0) (6.64) 

is well defined, linear, and there exists c > 0 such that for all £ in _D(A T *) 
and w in W 1,p (—h, 0; R m ) 

IC'ext(£+(0, Bqw, B\w ), 10(0)1 < c[\4>(0)\ + \\L(j)+Bow+(\\p+\\Ccl)+Biw+X\\p 
+ | L(f> + Bqw + C(0)| + \\L Dcj) + BqDw — iA0||p 

+ || CD(f> + BiDw - DX\\ P + |to(0)|]. (6.65) 

Proof. To verify that the map (6.64) is well defined, it is sufficient to show 
that 

((0(0), L0 + B 0 w + C, C0 + Bxw + A, io(0)) = 0 

implies that 

C0 + B lW + A(0) = 0. 

In particular 

0(0) =0 and 0 G W 1>P (-M;M") =► (£0)(O) = L0 and (C0)(O) = C0, 
w( 0) =0 and wGW 1,p (—h, 0; IR m ) => (Bqw)(0) =Bqw and ( Biw)(0) = BiW. 


As a result 


C0 + B\w + A = 0 => 0 = [C<j> + Biw + A](0) = C0 + Bpw + A(0). 

Inequality (6.65) follows by the same techniques as the ones used in the proof 
of Lemma 4.6. □ 

The direct consequence of Lemma 6.1 is that for initial conditions 

f G D(A t *) and w G W lj, (-/i, 0;R m ) 

and functions / and u verifying (6.55), 

C ex t(x(t),u(t)) = Cx t + Biu t + (e+ h \)(—t) = y(t) ( 6 . 66 ) 

as can be easily verified. This is the extension of (6.40) to the case where 
B i^O and the equivalent of (6.21) for the state x(t). 
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Proof of Theorem 6.1. (i) By linearity of system (6.25) and the definition 

(6.33) of the adjoint semigroup {<S' T *(t)}, it is sufficient to establish identity 
(6.42) for f = 0. We use the integration by parts formula (4.35) in Lemma 4.2 
for T = t 


f z(t — s) ■ [x — Ce° + x\(s) ds + z(t) ■ x(0), 

Jo t 

= / [z — C T e° + z\(s) ■ x(t — s) ds + z(0) • x(t), 
Jo 


(6.67) 


where x is the solution of 


x(t) = [Ce° + x + Boe+u)(t), t > 0, 

a;(0) = 0, 


y(t) = [Ce+x + B\e° + u](t), t> 0, 


( 6 . 68 ) 

(6.69) 


and z is the solution of 


U(t) = [C T z + C T (e°_v)\(t), t> 0, 

\(z(0),z 0 , (e°v) 0 ) = (ip(0),ip,v) € D(A T ). 

The substitution of (6.68) and (6.70) in (6.67) yields 

f z(t — s) • [6oe°u](s) ds = f [C T e°_ip+C T e°_v\(s) ■ x(t — s) ds+if(0) • x(t) 
Jo Jo 


= / [L t i/j + C T v\(a) ■ ( e + x )t(ot) da + ip(0) • x(t), 


and because L T = L* and C T = C* 

((ip(0),ip,v),(x(t),L(e° + x)t,C(e° + x)t)) = ( (Bje° + z)(t - s) ■ u(s) ds. (6.71) 


Bj e°z = Bq z — Bq e°_z = Bj z — Bje°_ip 


f {Bje°_ip)(t — s) ■ u(s) ds = f (Bje°_ip)(s) ■ u(t — s) ds 
Jo Jo 


= / (Bq ip)(a) ■ ( e + u )(t + a) da. 

J-h 


Substituting in (6.71) we obtain 


(0(0), ip, v), (x(t),L(e° + x) t + B 0 (e\u) t , C(e° + x) t )) 


= f (Bq z)(t — s) ■ u(s) ds = f Bq zt- s ■ u(s) ds. (6.72) 
Jo Jo 
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The missing term to obtain the state x(t) in (6.72) is 


(v,B 1 (e^_u) t ) = (Bjv,(e+u) t ) = / (Bje°_v)(a) • (e°w)(t + a) da 


= [ (Bje°_v){t - s) ■ (e°w)(s) ds 

J t—h 

= f Bj(e°_v)t- s ■ (e° + u)(s) ds 
J t—h 

= l Bj (e°_v)t- s • u(s) ds. 

Jo 


Finally 


{x(t),L(e%x)t + B 0 (e° + u) t , C(e%x) t + B 1 (e° + u ) t )) 

= / [Bjz t - s + Bj(e 0 _v)ts] ■ u(s) ds. (6.73) 
Jo 

But this is precisely identity (6.42) for £ = 0 and B T given by (6.43). 

(ii) and (iii) now follow by the same techniques as in the proof of Theo¬ 
rem 5.1 (ii) and (iii). □ 


6.3 Intertwining property of the two extended states 

In fact the two states are not completely unrelated: They are intertwined with 
respect to the structural operator 

F: R” xL 2 (-/i,0;R") xL 2 (-h,0;R m ) -> R” x L 2 (-h, 0; R") x L 2 (-h, 0; R fe ) 
defined by the following matrix of operators: 

/ 0 O' 

0 L B 0 . (6.74) 

Theorem 6.2. (i) Given initial conditions t; of the form 

S = (</>°, Lcj) 1 + B 0 w, Ccf 1 + B lW ) = F(4>°, (j) 1 , w ) (6.75) 

for 

(/^.w) G R” x L 2 (-/i, 0;R") x L 2 (-M;R m ), (6.76) 

then for all u in i 2 oc (0, oo; R ,u ) 

x(t'i F(<j>°, (f 1 ,w),u) = Fx(t ; (/^Sw^u), (6.77) 

where x is given by (6.26) and x by (6.4). 
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(ii) The following intertwining identities hold'. 

S r *(t)F = FS(t), Vi > 0, 
CF = C on D(A), 
B t F t = B r on D(A r ), 


where 


p* _ pT 


I 0 0 

0 L 7 c 7 

0 Bj Bj 


Proof, (i) By definition (6.26) 


(6.78) 

(6.79) 

(6.80) 


(6.81) 


x(t) = (x(t), L(e° l _x) t + B 0 (e%u) t + r(t)^ 1 , C{e° + x) t + Bi(e° + u) t + r(f)£ 2 ). 


By Lemma 4.4 


rft^Lf) 1 + B 0 w\ = L(e°_(/) 1 )t + B 0 (e°_w) t 

and 

T(t)[C<t> 1 + Biw\ = C(e°_(f> 1 )t + B 1 (e°_w) t . 

But 

x t = (e° + x) t + (e°_(j) 1 ) t , u t = ( e° + u) t + {e°_w) t 

and finally 

x(t) = (a :{t),Lx t + B 0 u t , Cx t + Biu t ) 

= F(x(t), Xt,u t ) = Fx(t). 

(ii) This is a special case of (i) with u(t) = 0, t > 0. From (6.33) 

S r *(t )£; = (x(t),L(e° + x) t + T(t)( 1 ,C(e° + x) t + r(f)f 2 ) 

= (x(t),Lx t + r(t)B 0 w, Cx t + r(t)B\w) 

= (a :(t),Lx t + B 0 (e°_w)t, Cx t + B 1 {e°_w) t ) 

= F(x(t),x t , ( e°_w ) t ) = FS(t)(<f> 0 ,(f>i,w) 

by definition (5.38) of the extended semigroup of Ichikawa. 

To prove identity (6.79) we make use of the intertwining property (6.78) 
and Lemma 4.5, which says that the corresponding infinitesimal generators 
are also intertwined: For all ((/>(0),<l>,w) £ D(A), 

FD(A) c D(A T *), A T *F((f>( 0), <f>, w) = FA(<f>( 0), <f>, w). 

Hence 

CF((f)(0), (f>, w) = C(<f>( 0), L(f> + B 0 w, C(f> + B\w) 

= C(f> + (.Biiz;)(0). 
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Recall that an element of D(A ) is of the form (0(0), (f>, w), where 
w € W^i-h, 0;R m ), u>( 0)=0. 

By Lemma 4.6 applied to B\ instead of L 

(Biw)(0) = Biw. 

Finally for all (0(0), </>, w) € D{A) 

CF(cj)( 0), 4>, w) = Ccf> + B\w = (7(0(0), (f>, w) 
for the operator C defined by (6.10): 

CF = C on D{A). 

For the control operator we use the dual intertwining identity 
F T S T (t) = S*(t)F r 
and for all (0(0), ip, v) € D(A T ) 

F t D(A t ) c D{A*), A*F t = F t A t . 

By repeating the previous arguments 

B t F t (^{ 0), v) = B t (i/>(0), L T ^ + C T v, Bq ip + Bj v) 

= Bjl>+{B?v)(0) 

and as 

(0(0), 0, v) € D(A t ) => v e W 1,2 {— h, 0; R fe ) and u(0) = 0, 
we conclude from identity (4.79) in Lemma 4.6 applied to Bj that 

(Bjv)(0)=Bjv 


and 

B T F T = Bj^ + Bjv = B t on D(A t ). □ 

Remark 6.2. The intertwining properties of Theorem 6.2 are new in the gen¬ 
eral case. Special cases were already considered in the case without delays in 
the observation (cf. M. C. Delfour [15]) and in the case without delays in 
the control and observation variables (cf. M. C. Delfour, E. B. Lee, and 
A. Manitius [1]). In the latter case, it was shown that the solutions of the 
Riccati equations for the states x and x are also intertwined. □ 
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Part III 


Qualitative Properties of Infinite Dimensional 
Linear Control Dynamical Systems 





Controllability and Observability for a Class of 
Infinite Dimensional Systems 


1 Introduction 

In §2.1 and §2.2 of Chapter 1 of Part I, we have discussed criteria for control¬ 
lability, and observability for finite dimensional systems and have also shown 
that when the system is controllable we can transfer the state Zq € H at time 
to to the state z\ € H at time t\ using minimum energy controls. These results 
were obtained by considering the controllability operator 

L t : L 2 (0, T ; U) -► H 

e ( T ~s)A Bu ( s ) ds , 

and its adjoint 

L* t : H -> L 2 {0,T-U) 

:y ^B*eV-) A 'y, 

and studying the relation between the ranges and null spaces of these two 
operators and by showing that controllability is equivalent to invertibility of 
LtL y As we have remarked (see Remark 2.1, Chapter 1 of Part I) in some 
sense the same ideas can be used to obtain characterizations of controllability 
when the spaces U and X are infinite dimensional Hilbert spaces, but at 
the expense of using much elaborate technical machinery. In this chapter we 
discuss questions of controllability for parabolic and second-order hyperbolic 
equations, the plate equation, and Maxwell’s equations. We first deal with 
controllability of the abstract linear dynamical system 

z'{t) =Az(t) + Bu(t), 

^( 0 ) = 0 , 

evolving in a Hilbert space H and where A is the infinitesimal generator of 
a strongly continuous semi-group e tA on H and B € £(U,H), where U is a 
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Hilbert space, the control space. In an infinite dimensional setting there are 
at least two concepts of controllability: approximate controllability and exact 
controllability. These concepts are introduced in Definitions 2.1 and 2.2, and 
criteria of approximate controllability and exact controllability for the above 
abstract linear dynamical system are presented in part (b) of Proposition 3.1 
in §3.1 and in (3.4) of §3.2. Approximate controllability and null controlla¬ 
bility for parabolic equations (distributed, boundary, and pointwise control), 
are studied in §5 by converting it to the abstract model (1.1) in appropriate 
spaces. The exact controllability problem for hyperbolic equations (Neumann 
and Dirichlet boundary control), the plate equation, and Maxwell’s equation 
is studied by first studying exact controllability of the model (1.1) by spe¬ 
cializing A to the case of skew-symmetric operators (§6 and §7) and then 
converting the various partial differential equations to this abstract model in 
appropriate spaces where the assumptions of the abstract results are veri¬ 
fied. The method of proof for the abstract model makes essential use of the 
eigenvalue-eigenfunction structure of an appropriate partial differential op¬ 
erator related to the generator A and hence assumptions need to be made 
on the control operator B in relation to these eigenfunctions (assumptions 
that clearly have to be verified in concrete cases), so that lower estimates on 
boundary operators can be obtained. 

For partial differential equations, the study of controllability has some in¬ 
trinsic interest. Indeed, it appears that the most natural approach to the exact 
controllability problem for hyperbolic equations is obtained by using the the¬ 
ory of pseudo-differential operators and micro-local analysis as developed by 
Melrose and Sjostrand (see C. Bardos, G. Lebeau, and J. Rauch [1]). For 
our purposes the theory of controllability (in particular exact controllability in 
suitably defined spaces) provides a criterion for stabilizability, a requirement 
for infinite time quadratic control problems to be well posed (see Part V). The 
interplay between the choice of state and the control spaces in the formulation 
of infinite time quadratic control problems, regularity properties for solutions 
of partial differential equations and verifying exact controllability properties 
in these spaces (leading to stabilizability and uniform stabilizability) is subtle 
and has only been worked out in the eighties (see, in particular the recent 
work of I. Lasiecka and R. Triggiani [11], J. L. Lions [5], and Chapter 2 
and 3 of Part V). A general methodological approach to these issues is via the 
Hilbert Uniqueness Method (HUM) of J. L. Lions. 

The scheme of development adopted in this chapter, although not necessar¬ 
ily leading to the sharpest results, has considerable appeal (especially from an 
engineering viewpoint) and provides a bridge between the finite dimensional 
and infinite dimensional theory. It uses the controllability operator and mini¬ 
mum energy transfer between states in an essential way. It is therefore of some 
interest in placing it both in historical context and also in the context of most 
recent developments in the subject. For this purpose we cite three sources on 
which the remainder of this section is based (see I. Lasiecka and R. Trig¬ 
giani [11], J. L. Lions [5], and D. L. Russell [1]). For finite dimensional sys- 
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terns, the concept of controllability first arose as a technical condition related 
to normality and abnormality of Calculus of Variations problems and in ob¬ 
taining structural results on the reachable set (see J. P. LaSalle [1]). In the 
same way, the concept of approximate controllability and its characterization 
first arose in the work of Yu. V. Egorov [1] again as a technical require¬ 
ment in the study of time-optimal control problems for parabolic systems. 
An important early contribution to controllability is H. O. Fattorini [1], 
There is a close relation between approximate controllability and observabil¬ 
ity (see Definition 3.1 and Proposition 3.1). In concrete situations involving 
parabolic partial differential equations, approximate controllability is verified 
via observability using uniqueness and unique continuation theorems for the 
adjoint system (for an early use of this idea see J. L. Lions [3] who used a 
uniqueness theorem of S. Mizohata [1] to achieve the desired objective). Our 
results in §5, especially Theorem 5.2 and Lemma 5.1, implicitly use uniqueness 
and unique continuation ideas. For other work related to §5, see H. O. Fat¬ 
torini [1, 2, 4]; R. C. MacCamy, V. J. Mizel, and T. I. Seidman [1]; 
E. J. P. G. SCHMIDT and N. Weck [1]; and §3.3, Chapter 2, Part V. 

A deeper issue in the context of parabolic systems is the concept of null 
controllability (exact controllability to the origin), that is, the ability of trans¬ 
ferring an arbitrary state zo G D(A) to the zero state in time T > 0 us¬ 
ing admissible controls. This question and its observability counterpart have 
been investigated by several authors (see, for example, H. O. Fattorini 
and D. L. Russell [1], V. J. Mizel and T. I. Seidman [1, 2], T. I. Sei¬ 
dman [1], and W. Littman [1]). Most of the results known here are for 
parabolic equations in one-dimension (the work of Seidman being an excep¬ 
tion) and are based on deep results in Harmonic Analysis (excepting the work 
of Littman, which uses different ideas) related to the independence of ex¬ 
ponentials e~ Xkt , where A k are eigenvalues of appropriate partial differential 
operators entering the dynamical system. The work in the early seventies 
started in one-dimension, but both V. J. Mizel and T. I. Seidman [1, 2] 
and H. O. Fattorini and D. L. Russell [1] proved the result for balls, and 
it was well known that this gave the result for general domains by extension 
to a ball containing the domain and then restriction to the domain and its 
boundary. Null controllability is not discussed here, but we conjecture that 
the methods that we adopt would lead to results for parabolic equations. 1 

The focus of this chapter is on exact controllability (which is often a mean 
of verifying stabilizability) for second-order hyperbolic equations, plate equa¬ 
tions, and Maxwell’s equations. The reason for this is that there is an essential 
difference between the problem of stabilizability (uniform stabilizability) for 
parabolic systems and for hyperbolic systems. In the parabolic case, we are 
generally dealing with a semigroup that is analytic with a compact resolvent 


1 Since 1993, this topic has received more attention. The reader is referred to the 
book of A. V. Fursikov and O. Yu. Imanuvilov [1] in 1996 that studies null 
controllability via Carleman estimates. 
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and hence A (the generator) has only finitely many unstable eigenvalues with 
finite multiplicity. In this case we have to check whether the projection of A 
on the unstable subspace is controllable, and this can be done via the Pole- 
Assignment Theorem (see Theorem 2.4, Chapter 1, Part I). These issues are 
dealt with in §3.3 of Chapter 1 of Part V and §3.3 of Chapter 2 of Part V. 
Concrete situations, such as the heat equation with control exercised through 
Dirichlet or Neumann boundary conditions, can be handled using these ideas 
(see Remark 3.1 of Chapter 2 of Part V for bibliographical references). 

For second-order hyperbolic equations (and for plate and Maxwell’s equa¬ 
tion) the stabilizability question is far more difficult because these systems 
have an infinite dimensional unstable (marginally stable) part. It is here that 
the study of exact controllability is most important and this has been carried 
out in J. L. Lions [4, 5] and I. Lasiecka and R. Triggiani [9, 10, 13] and 
others (see the bibliographical references cited in the above-mentioned works). 
We remark here that the key to these results are estimates on boundary op¬ 
erators. 

Let us examine this in the context of the wave equation with Dirichlet 
control (see Example 2.1 in Chapter 3 of Part V). 

In this case we denote by A the operator 

Ah = -Ah, V(A) = 

and by D the Dirichlet map 

Dv = y ■<==> {Ay = 0 in Q and yao.=v). 

and the state space H = L 2 (Q) x U _1 (D) and the control space U = L 2 (dfl). 
Then the abstract model is 




We may then compute 

B* H = D*y 2 = -^-A~ 1 y 2 since D*A = 

Jj2\ ov ov 

Hence 

B*e A * 4 I] =|^), (j/i, 2 / 2 )eL 2 (D)x J R- 1 (D), 

and ip is the solution of the homogeneous equation 

{ <ptt = Aip in S2 x ]0, T[ip = 0 in i9f l x ]0, T[ 
ip(-,0) = ip o in ft. 

<Pt(-,0) = pi 

Now 
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Vo 


= A~ l y 2 £ V(A 1/2 ) = ft^O), Vi = |/i G L 2 (n). 


The two relevant estimates are (see Example 4.3 in Chapter 3 of Part IV and 
Example 2.1 in Chapter 3 of Part V): 


(i) 

(ii) 


dip 


dv 

dip 


dv 


dS < c(T)||{<p 0 ,<Mllff o i (Q)xL 2 (Q)’ 

2 

dS > c(T)||{<^0) < i ? i}|lHi(n)xL 2 (Q) 


at least for large T, where S = dtt x ]0, T{. By virtue of the fact that 


B*e AH 


- £“>• 


the inequality (ii) above is equivalent to the invertibility of the controllability 
operator 

e tA BB*e tA * dt , 

and this is the criterion for exact controllability. 

In the case of control through Neumann Boundary conditions it is difficult 
to identify the space on which the above estimates on boundary operators 
hold. 

For a discussion of the above examples in the abstract setting developed 
in this chapter, see Theorem 6.1 and §8.1 and §8.2. 



2 Main definitions 

2.1 Notation 

Let H be a complex Hilbert space, identified with its dual. More specifically 
H is the complexified version of a real Hilbert space, also denoted by H to 
save the notation. This means that an element of H complexified is of the 
form 

h = hi + ih 2 , with hi,h 2 £ H. 

The norm in H real is denoted by | • | and the scalar product by (•, •). In H 
(complexified) the scalar product of ft and h! is denoted by (ft, ft') where h' is 
the conjugate of ft. The norm of ft is |ft | = (ft, ft) 1 / 2 . 

We consider a linear operator A: D(A) —> H and B £ £(U;H), where U 
is also identified with its dual. We call H the state space and U the control 
space. The norm and scalar product in U is denoted in the same way as for 
H 1 and possibly with a subscript U when there is a risk of confusion. A and 
B are defined when H and U use scalars that are real valued, and are real 
valued. They are extended to the complexified versions of H and U by setting 
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Ah = Ah\ + iAh,2 

and similar formula for B. In the sequel, the complexified versions are needed 
because of eigenvalues (in fact only starting with §6). Note that the operator 

A*h = A*h l +iA*h 2 


satisfies the condition 


Mh,ti, {A*h,h') = {h,Ah') 

and is the adjoint of A considered as a linear operator in H complexified. 

We consider the linear dynamical system 

/ = Az(t) + Bv(t), t £ (0,T), 

\*( 0 ) = 0 . ( ' ] 

We assume that A is the infinitesimal generator of a strongly continuous 
semigroup e At in H. The control function v(-) belongs to L 2 (0,T\U) (U is 
the ordinary real version). The solution of (2.1) is denoted by z(t\v ) and 
naturally 

z(t;v) = f e ( ' t ~ s ^ A Bv(s) ds. (2.2) 

Jo 


2.2 Definitions 

We set 

F t = {z{T;v):\/v € L 2 (0,T-U)}. 

We can provide Ft with the structure of a Hilbert space thanks to the follow¬ 
ing. 

Proposition 2.1. The space Ft can be structured as a Hilbert space, with 
continuous injection in H. 

Proof. Consider the closed subspace of L 2 (0,T\U) made of v(-) such that 
z(T;v) = 0. Let Nt be this subspace, and L 2 (0,T;U)/Nt be the Hilbert 
quotient space of L 2 (0, T; U) by Nt- If «(•)“ is an element of L 2 (0,T; U)/Nt, 
and u(-) is a representative of u(-)°, then the quotient norm is given by 

|u°| 2 = min{ J(v): v £ L 2 (0,T; U), v — u £ Nt}, (2-3) 

where we have set 

J(v) = I \v(t)\ 2 dt. 

Jo 

If u realizes the minimum in (2.3), then the scalar product in 

L 2 (0,T; U)/N t 
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is defined by 

( u°,v°)= f (u(t),v(t)) dt. 

Jo 

We define the map F t from F 2 (0,F; U)/Nt to Ft by setting 

F T {u°) = z(T;u ) 

and Ft is clearly a bijection. We define on Ft a structure of Hilbert space by 
setting 

(&»?)) = (^t^tV (2-4) 

By construction Ft is an isometry. It remains to show that the injection of 
Ft into F[ is continuous. We show that 

l|r > C, € Ft- (2.5) 

Indeed if (2.5) does not hold, then there exists a sequence £„ in Ft, such that 
|£ n | = 1, and £„ — ► 0 in Ft- Let u° = Fi^ 1 ^, and u n be the representative of 
it° of minimum norm; then u n —» 0 in L 2 (0, T; 17) and = z{T\ u n ); therefore 
—> 0 in H, which contradicts the fact that |£„| = 1. The desired result has 
been proved. □ 

Let Fj. be the adjoint of Ft- It is an isometry from F.'' T to F 2 (0,T; U)/Nt- 
Therefore the map FtF j. is an isometry from F. " T to Ft- If £ € Ft, defining 
C* G Ft by the equation 

F t F* <*=£ (2-6) 

and considering the class Ft£* € L 2 (0,T\U)/Nt, then any representative 
of this class will realize £. The canonical isomorphism from Ft into F’ T is 
(Ft^t ) -1 = (F^)~ 1 (Ft )~ 1 ■ The norm product in Fy is ||£*|| = \F^,^\. 
Consider now the operator 


r T 

F T = / e tA BB*e tA dt, 

Jo 

which belongs to C(F[;H). We call Ft the controllability operator. We can 
decompose Ft as a product of an operator with its transpose. For that, intro¬ 
duce 7r the injection of Ft in Ft and 7r* its transpose. Note that n*H is dense 
in F^. We can then give an interpretation of We have 

ipT^hit) = equivalence class of B*e^ T ~^ A h. (2.7) 

Let u° G F 2 (0,F; U)/N t . We have 

{ipTir*h,u 0 ) = (, h,z(T;u )), 

where u is the representative of minimum norm of u°. Hence, 
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(i/jt 1 r*h,u°) = f (f?*e^ T t ' )A h,u(t))dt. 

Jo 

Therefore what remains to be done is to show that B*e^ T ~ t ' ,A h minimizes 
the norm of elements that belong to its equivalence class. According to (2.3) 
we look for the element v that minimizes 

J{v) = f \v{t)\ 2 dt 
Jo 

among all v such that 

e (T-t)A B ( v ^ _ B * e {T-t)A - h ) dt = Q (2. 8 ) 

The optimal v satishes (2.8) and 

(v{t), v(t)) dt = 0 

for all v such that 

e( T ~ t)A Bv(t) dt = 0. 

It is clear that v(t) = B*e < ' T ~ t ' )A h satishes this necessary condition, and thus 
the property (2.7) has been demonstrated. 

From (2.7) we deduce at once the decomposition 

r T = (2-9) 

We now introduce the following. 

Definition 2.1. The pair (A, B ) is approximately controllable at time T when¬ 
ever Ft is densely embedded in H. □ 

If the pair (A, B) is approximately controllable, then the map 7r* is injec¬ 
tive. In that case we can identify an element h of H, with its image 7r*/i, and 
7 t*H with H. In that case we have 

F t C H C (2.10) 

with continuous and dense embedding of each space in the following one. 
Moreover from (2.9) we have 

Ft = V'tV’t (2-11) 

and Tr extends as an isometry from F' T to Ft- If h £ H , then 

\\h\\ Fi , = (r T h,h ) 1/2 ( 2 . 12 ) 

and F' t appears as the completion of H with respect to the norm (2.12). 

Suppose that the pair (A, B) is approximately controllable; then D{A) and 
Ft are two dense subspaces of H. An important question is the comparison 
between these two spaces. This justifies the following definition. 
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Definition 2.2. The pair (A, B) is exactly controllable at time T whenever 

D(A) c F t 


with continuous and dense injection. □ 

One may wonder why we do not use as a definition of exact controllability 
at time T, the property Ft = H. The reason is that as soon as Ft is infinite 
dimensional, this property is not generally verified, except for special families 
such as the hyperbolic systems. To partially support this assertion, we can 
state the following 

Proposition 2.2. R. Triggiani/T/ If Ft is infinite dimensional and B is 
compact, the property Ft = H cannot hold for finite time T. 

Proof. The operator B is compact, there exists a non unique sequence of 
orthonormal vectors Wk of U and positive numbers otk, which tends monoton- 
ically to 0 as k tends to infinity, such that 

w' k = — Bwk is an orthonormal sequence of H , 

OLk 

OO 

Bv = 

fc=o 

Let {v m } be a sequence in L 2 ( 0, T;U), which tends to 0 weakly and z m (T) = 
z(T;v m ). We shall show that 

z m (T ) —> 0 strongly in H. (2-15) 


(2.13) 

(2.14) 


If (2.15) is proved, then defining Ff = subset of Ft obtained with v restricted 
to the ball of center 0 and radius n, it is clear that Ff has a compact closure 
in H. As H is infinite dimensional, Ff has an empty interior. It is nowhere 
dense. 

Now 

OO 

F t C U Ff. 

n= 1 

Therefore, according to Baire Category theorem, Ft cannot coincide with H. 
Similarly 

_ _ OO 

U Ft = |J F m C |J FZ 

T> 0 m> 0 n,m =1 

cannot coincide either with H. 

It remains to prove (2.15). Using (2.13) one has 


oo ,.T 

l {T) = Y J *k / 

fc=o "'° 


e (T t)A w' k {vm{t),Wk)dt. 


(2.16) 
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Let 



e (T i)A w' k (v m {t),w k ) dt. 


As v m tends to 0 weakly in L 2 (0,T;U), its norm remains bounded. Then it 
is easy to check that 


I Zm(T) - z m>N (T) I < CaN 

independently of to. As aw tends to 0 as N tends to infinity, to prove (2.15) it 
is sufficient to prove that z m ,Ar(T) tends to 0 as to tends to infinity, for fixed 
N. For this it is enough to prove that 

e ^ T ~i) A hf m (t) dt —> 0 in H 

whenever f m tends to 0 weakly in L 2 ( 0, T) and h is a fixed element of H. This 
is an easy consequence of the fact that 1 1 —> e^ T ~^ A h is a continuous function 
on [0, T] with values in H. The proof has been completed. □ 

In the sequel, we shall be interested in obtaining criteria for approximate 
and exact controllability. 



3 Criteria for approximate and exact controllability 

3.1 Criterion for approximate controllability 

We introduce the following definition. 

Definition 3.1. Given T > 0, we say that the pair (A*,B*) is observable on 
(0, T) when 

B*e tA *h = 0 on (0,T) => h = 0. (3.1) 

□ 


We can state the following result. 

Proposition 3.1. The following statements are equivalent: 

(a) The pair A*, B* is observable on (0,T), 

(b) (r T h, /i) 1/2 is a norm on H , 

(c) the pair (A, B) is approximately controllable at T. 

Proof If the observability property holds, then {TTh,h)>0 and (Pr/j,/i) = 0 
implies B*e tA h = 0 on (0,T); therefore, h = 0. 

If {TtH, h) 1 / 2 is a norm on H, then if h satisfies B*e tA h = 0 on (0, T), 
(TtIi, h) = 0 hence h = 0. Hence (a) and (b) are equivalent. 

Now approximate controllability at T is equivalent to 
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( z(T;v),h ) = 0, 


Vi> 


h = 0. 


(3.2) 


But 


(z(T;v),h) 


e ('r-i) A B v (t) dt, h 



{v(t),B*e (T - t)A *h)dt. 


Therefore 

to, (z(T;v), h) = 0 B*e^ T ~ t)A 'h = 0 
and (3.2) is thus the same thing as observability. Hence (a) and (c). 


□ 


3.2 Criteria for exact controllability and continuous observability 

From our definition of exact controllability we deduce the sequence 

D(A) C F t c H c F' t c (D(A))', (3.3) 

each space being densely and continuously embedded in the following one. 
From (2.12) we deduce 

(r T h,h) > c T \\h\\f D(A) y (3.4) 

for any h £ H . 

Conversely, if (3.4) holds, then (3.3) holds. Indeed necessarily 

F* t c(D(A))'. (3.5) 

To prove (3.5) consider the vector space F!pC\ (D(H)) / provided with the norm 

ll£l|p£n(.D(A))' = max{||£||i^, ||£|| 

Let £ € F' t and consider a sequence {£„} in H, => £ in F' T . Note 
that {£„} is a Cauchy sequence in F' T and from (3.4) a Cauchy sequence 
in ( D(A )) . Therefore is a Cauchy sequence in fl ( D{A )) . It follows 
that £ € F' t n (D(A))' , in particular to (Z}(H))^ Hence (3.5). From (3.4) the 
injection is clearly continuous. As H is dense in (H(A)) / , F!p is also densely 
embedded in (D(A)) 1 . By duality we deduce (3.3). Therefore, the estimate 
(3.4) is a criterion of exact controllability. 

Remark 3.1. There is an analog of Proposition 3.1 for exact controllability. For 
this purpose, define the dual system as follows: First introduce the observation 
equation for the system (2.1) 


y(t) = Cz{t), 

where C £ C(H;Y), and the observation space Y is a Hilbert space identified 
with its dual. Then introduce the dual system (backward equation) 
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{p'(t) = —A*p(t) + C*y(t), 

\p(T) = 0, 

and the dual observation equation 

u{t) = B*p{t). 

We then say that the pair (A, C) is continuously observable if and only if the 
pair (A*, C*) is exactly controllable at time 0 (starting at time T). Therefore 
we obtain a criterion analogous to (3.4) for continuous observability. □ 

3.3 Approximation 

Let h be an element of H. There exists a sequence {£„} of elements of Ft 
which converges to h in H. Solving the equation 

'-WC = 

defines a unique (* in F’ T . Any control of the equivalence class * realizes 
In this way we can construct a sequence of controls whose corresponding 
state at time T is as close as possible to h. But this procedure is not very 
constructive. A constructive approach is obtained in the following way: Define 



J e (v) = J(v) + z(T;v) - h\ 2 

(3.6) 

with 

z(T;v) = [ e (T ~ t)A Bv{t)dt 

Jo 

(3.7) 

and minimize J e (v) over all v £ L 2 (0,T;[7). This problem has a unique solu¬ 
tion u e . We have 


I z(T-,Ue) - h\ 2 < I z(T;v) - h\ 2 +eJ(v), \/v, 


and thus 

limsup \ z{T\ u e ) — h\ 2 < inf \z(T\v) — h\ 2 = 0. 

£—>0 


Therefore the sequence z(T\u e ) belongs to Ft and converges to h in H as £ 
tends to 0. Now we may write the necessary conditions of optimality for u e . 
It is easy to check that if p e is the adjoint state defined by 


-p' e = A*p e , p e (T) = \(x e (T) - h), 

(3.8) 

then 

u e (t ) = -B*p e (t) = -f?*e( T -*) A *p£(T) = -nPe{T). 

(3.9) 


Therefore 
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z(T;u e ) = -r T p E (T). (3.10) 

Since p e (T) G H and not just to F,'ip, we have an even better result than that 
explained at the beginning of the paragraph. 

If h belongs to Ft, then we can say something more. Indeed let u be such 
that 

FtU = h 

and u has minimum L 2 norm. As 

J(u e ) < J(u), (3.11) 

it follows that u e remains bounded in L 2 . From the formula (3.9), it follows 
that p e (T) remains in a bounded subset of F’ T . We pick a subsequence, still 
denoted by p e (T), which converges weakly to <j* in F. " T . Going to the limit in 
(3.10) yields 

h = -r T ( *. (3.12) 

From (3.11) and the minimality of u, it is easy to check that u e tends to u in 
L 2 (0,T;U). From (3.9) we deduce also 

u = (3.13) 

and thus we have an approximation procedure for the element . 

We refer to A. Bel Fekih [1] for related topics. 


4 Finite dimensional control space 

We shall consider in this section the case when U is finite dimensional, U = 
R m , and make precise the conditions of controllability (clearly approximate 
and exact controllability coincide in that case). 

4.1 Finite dimensional case 

Assume here that H = R n and U = R m , A G £(R n ; R"), B G £(R m ; R n ). We 
have the following classical result due to R. E. Kalman [1], for which see 
Theorems 2.1 and 2.2, Part I, Chapter 1. 

Proposition 4.1. The pair (A, B) is controllable at any time T > 0 if and 
only if the matrix [B AB ... A n ~ 1 B\ G £(R” m ;R”) has rankn. 

Consider now the case of diagonalizable operators 

J 

A = Y. X i P A ( 4 - 1 ) 

j=i 

where Xj is complex valued, Pj is a projector, satisfying 
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Pj = p;, PjP k = s jk , J2 p i = L 

j -1 

Note that we have complexified the set up, so P* means 
(P*h, k) = (h, Pjk) — (. Pjh , fc); 

hence 

j 

3=1 

We then state the following proposition. 

Proposition 4.2. Assume (4.1); then the pair ( A,B ) is controllable at any 
time T > 0, if and only if for any j, the operator PjBB* Pj has full rank, in 
the subspace PjH. 

Proof. 

• The condition is necessary. 

Suppose otherwise that there exists some h, with Pjh ^ 0, and B*Pjh = 0; 
then 


B* 


' B* Pjh ' 

B* A* 

P,h = 

XjB*Pjh 

q* j^*n— 1 


_Xj n ~ 1 B*P j h_ 


which contradicts the fact that the pair ( A , B) is controllable. 

• The condition is sufficient. 

Consider an element h such that (Prh, h) = 0; hence B*e A t h = 0; i.e., 

j 

^exp(X j t)B*P j H = 0, te(0,T). (4.2) 

3=1 

From the analyticity of the function to the left of (4.2), it follows that (4.2) 
holds for any t £ (—oo, +oo). It first follows that B*Pjh = 0, for any j such 
that Re ^ 0. Indeed, suppose Ai is such that | Re Ai | > | Re A;|, Vj ^ 1. 
We can write 

B*P x h + ex P (( A "i - A“i )t)B*Pjh = 0. 

3¥1 

Taking the limit as t tends to + or — infinity, according to the fact that Re Ai 
is positive or negative, we deduce B*P x h = 0. More generally, there may be a 
set Jo of indices j such that Re A j = Re Ai, for j € Jo, and | Re Ai | > Re A; |, 
Vj ^ Jq. Dividing (4.2) by exp(ReAif) we deduce 
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53 e~ iljt B*P j h + 53 exp(Aj - Re \ 1 )tB*P j h = 0, (4.3) 

jeJ 0 j&Jo 

where 7 j = ImAj. Suppose to fix the ideas that ReAi > 0. We derive from 
(4.3) 


0 = 


53 e~ iljt B*Pjh 


j6 Jo 


dt 


+ f [53 e +i ^ t B*Pjh, 53 exp(A fc - Re X 1 )tB*P k h ) dt- 
Vie Jo WJ 0 I 


hence 


0 = TY J (PjBB*P J h,h)+Y J E 


je Jo 


j£Jo fee Jo 


exp(i(7fc - 7j)T) - 1 

*(7fe - 7 j) 


{P k BB*Pjh, h) 


e e CX11|A : - B :. A : 


jeJo fc#Jo 


Afc — Re Ai + *7j 


Dividing by T, and letting T tend to 00 , we deduce 

53 (P j BB*P j h,h) = 0, 

je Jo 

or B*Pjh = 0, Vj € Jo- If ReAi < 0, one should consider a similar integral 
between — T and 0, to deduce a similar result. 

Successively, we can treat in the same way all j such that Re A, ^ 0. So 
we have 

B*Pjh = 0, Vj with ReAj 7 ^ 0. 

There remains the case when (4.2) reduces to 


53 e~ iljt B*Pjh = 0, Vt € (- 00 , + 00 ), 
je Jo 


where Aj = * 77 , 7 , real, and Jo is a subset of {1,..., J}. We make a calculation 
similar to that done after (4.3) to prove that 

53 (PjBB*Pjh,h) = 0, 

jeJo 


or B*Pjh = 0, Vj € Jo- 

Hence, we have proved that B*Pjh = 0, Vj, and this implies h = 0, from 
the assumption. □ 
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4.2 General state space 

We now turn to the case of a general state space, with finite dimensional 
control space U = R m . We have 

m 

Bu = '^^biUi, with b\, b 2 , • • •, b m G H, «eK ro . (4-4) 

»=i 

We state (see L. Markus [1]) the following theorem. 

Theorem 4.1. Assume that 

b 1 ,b 2 ,...,b m £D 00 (A) = f|T>(A fc ). 

k> 0 

If the linear set generated by the vectors 

A k bj, j = 1,... ,m, k = 0,1,... 

is dense in H , then the pair ( A , B ) is approximately controllable at any time 
T > 0. Conversely, assume that bj = e tjA bj, with bj £ D oc (A), tj > 0, and 
the trajectories (e tA bj,z) for any z £ H are real analytic; then if the pair 
( A, B) is approximately controllable at some T > 0, necessarily the linear set 
generated by the vectors {A k bj,j = 1,..., m, k = 0,1,... } is dense in H. 

Proof. If A, B is not approximately controllable at T > 0, then A*, B* is not 
observable on (0, T) (see Proposition 3.1). Hence 

3 h ^ 0, such that Vt £ (0,T); B*e tA h = 0; 

hence also 

V«er, {e tA Bu, h) = 0 in (0, T). 

This implies 

Vj = l,...,m, (e tA bj,h) = 0 in (0,T). (4-5) 

From the assumption on the b : fs, we can differentiate in t as many times as 
we wish and set t = 0. We deduce 

\/k > 0, j = l,...,m, (A k bj,h) = 0. (4.6) 

As h ^ 0, this contradicts the fact that the set generated by the vectors 
{A k bj, j = 1,... ,m, k = 0,1,... }. is dense in H. 

Let us now prove the second part of the statement. Assume that the set 
generated by the vectors {A k bj,j = 1,... m, k = 0,1,... } is not dense in H. 
There exists h ^ 0 such that (4.6) holds. This means also 

(A k e tjA bj,h) = 0. 


(4.7) 
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Set 

fj(t) = (<e tA bj,h ), 

which is real analytic. Then (4.7) means that = 0, ) = 0, Vfc > 0. 

Therefore, fj(t) = 0, Vf > 0. Writing fj(t + tj) = 0, we have also (4.5). 
Therefore the pair (A*, B*) is not observable on (0,T), which implies that the 
pair cannot be approximately controllable at T. □ 

Let us give a variant of Theorem 4.1 in the case when —A has a discrete 
spectrum Ai < A 2 < • • • A*, • • • with A*, t 00 and X k has multiplicity tv It bears 
similarity with Proposition 4.2. Using the projector P k on the finite dimen¬ 
sional eigenspace corresponding to A k , the semigroup e tA is then represented 
by the expansion 

e tA h = ^2e~ Xkt P k h. (4.8) 

k 

We consider P k as an element of C(H\ H). It is self-adjoint and Pf. = P k . We 
have 

r T 

2 (T;u) = V/ e- {T - t)Xk P k Bu{t)dt , (4.9) 

k Jo 

T 2 

{r T h,h)= [ y\e- Xkt B*P k h dt. (4.10) 

Jo k 

We shall prove the following result. 

Theorem 4.2. Assume that (4.8) is verified. Then the pair ( A, B ) is approx¬ 
imately controllable at T if and only if P k BB*P k is full rank, for any k. 

Proof. From Proposition 3.1 we know that the pair ( A,B ), is approximately 
controllable at T if and only if (Ir^, h) is a norm on H. From the expression 
(4.10), we deduce that (TY/i, h) is a norm on H if and only if 

J2e~ Xkt B*P k h = 0 on (0, T) => h = 0. (4.11) 

k 

The function 

t ^^2e~ Xkt B*P k h 

k 

being analytic, the left part of the statement (4.11) implies also 

e~ Xkt B*P k h = 0, Vf > 0. 

k 

Multiplying by e Xlt and letting t tend to infinity, we deduce B*Pih = 0, and 
successively B*P k h = 0. Therefore (4.11) means also 

B*P k h = 0, V/c > 0 => h = 0. (4.12) 


It is easy to check that (4.12) is equivalent to the property that the matrix 
P k BB*P k be full rank for any k. □ 
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Remark 4.1. The restriction of the system to E k (eigenspace corresponding to 
Xk) is given by the dynamics 

4 = -AfcZfc + B k u, z k ( 0) = 0, (4-13) 


where B k = P k B. The state z k lies in the finite dimensional space E k . The 
pair (—Afe/, B k ) is controllable. □ 

Remark 4.2. Note that the condition (4.12) holds also when U is not finite 
dimensional. Note also that from the formula (4.10) it follows that there exists 
a positive constant c such that 


(Tr/i, h) < c ]P 
k 


(1 — e~ 2XkT )\P k h\ 2 

2Afc 


(4.14) 


□ 


5 Controllability for the heat equation 


5.1 Distributed control 


We consider a bounded domain of K™, denoted 12, assumed to be smooth to 
simplify a little. Let r be the boundary of 12 and E = r x (0,T). Let O 
be a subdomain of 12. We denote by xo the characteristic function of the 
subdomain O. We consider the dynamic system 

! z' - Az = v(x,t)xo, 

z \ s = 0, (5.1) 

z{ x,0) = 0, 


with v the control belongs to L 2 (O x (0, T)). In fact, (5.1) can be written under 
the general framework (2.1). Indeed, let H = L 2 (Q) and D(A) = H 2 ( 12) fl 
Hq (12). We take A = A, and D(A) is equipped with the norm \Az\, z e D(A). 
Note that A is an isometry from D(A) to H. Let next U = L 2 (0), and if u 
belongs to U, 


Bu = 


u(x), 

0 , 


if x € O, 
if x £ O. 


It is well known that there exists a sequence 0 < Ai < A 2 < • • • X k T 00 of 
eigenvalues and w k j, j = 1 ,,r k , corresponding eigenvectors where r k is the 
multiplicity of X k , with 


Aw k j X k w k j, 
yJkj C H 0 (12), \wp-j | 1- 


(5.2) 


Moreover (4.5) hold true. We can then state the 
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Theorem 5.1. The pair (A, B) defined above is approximately controllable at 
any time T > 0. 


Proof. From Remark 4.2 it is sufficient to check that the condition (4.12) 
holds. Note that B*h = h\o, and thus since B £ = B*P k , condition (4.12) 
means 

rk 

Yiw kj ,h) w k j\o = 0 Vfc => h = 0. (5.3) 

3 =1 


The function 


rk 

Y( u ’kj , h) W k j 
3 = 1 


is analytic in O. From (5.3) it follows that it is identically 0. Hence the co¬ 
efficients (w k j, h ) = 0. As this holds for any k and j = 1 ,r k , necessarily 
h = 0. The desired result is thus proved. □ 


Remark 5.1. From (4.14) we have 


i _ -2A k T Tk 

(P T h, h)<cY 2l-£’ h ) 2 

k k j—1 


< = 
fc ^ _7 = 1 


IT- 


This means that 

iJ _1 (H) C 

with dense and continuous injection. By duality, it follows that 

Ft C Hq(Q,) 


with dense and continuous injection. Clearly Ft increases with the Lebesgue 
measure of O, and Ft = l?g(H), when O = fi. In that case, exact controlla¬ 
bility holds true. □ 


5.2 Boundary control 

Consider the following situation, using a formal write-up 

C'-AC = 0, c| r = v, C(*;0)=0, (5.4) 

where v(t) £ U = L 2 (r). We need to clarify in what space £(T) lies and to 
what extent we can reduce (5.4) to the general framework (2.1). 

In fact, we shall show that C(T',v) lies in (Ff 2 n-ffQ)', and £ € C(0;T; (U 2 n 
Hq)'). One defines £(T) by the transposition method of J. L. Lions and 
E. Magenes [1]. Let h be an element of L 2 (f2) = H\ then (— A)~ 1 h £ H 2 C\Hq. 
Consider the solution if of 
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{ —ip' — Aip = 0, 

i>\ r = 0, 

ip(x;T) = — (—A)~ 1 h = A~ l h 
(recalling the notation A = A), 

and we note that ip = — (—where 


(5.5) 


(-<,t >' - A(j> = 0, 

\ 4\ r = 0 , ( 5 - 6 ) 

[ 4>{ x 'i T) = h. 


Clearly cp e C(0;T;H ) and ip € C(0;T;U 2 n Hq). If we perform a formal 
integration by parts between (5.4) and (5.5), we obtain 


« (T),iP(T)) = - £ J^drdt, (5.7) 

and this constitutes the definition of £(T) as an element of ( H 2 n Hq)' = 
(D(A))'. 

Consider now the operator n € £(ld 2 ; L 2 (C)) defined by 


ncp = 


d(p 

dv ’ 


(5.8) 


We set 

B = (-Z\)-V = -A-'n*, 
which belongs to C{L 2 {r)\H). We consider 

fz' = Az + Bv, 

\*( 0 ) = 0 . 

Noting that (5.6) is equivalent to 


-</>' = M, 

HT) = h, 


then from (5.10) and (5.11) we deduce 


(z(T),h) = J ( <p,Bv)dt = j ( B*(p,v)dt 

= ~l = (§£•») 


dt, 


(5.9) 


(5.10) 


(5.11) 


(5.12) 


which is exactly the right-hand side of (5.7). Hence 
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(z(T),h) = (C{T),-(-A)~ 1 h). (5.13) 

Therefore 

z(T) = -(-A)~ 1 C(T). (5.14) 

Similarly for any t, z(t) = — (—Z\) _1 ^(t), and as z € C(0,T-, H), 2 we deduce 
that C € (7(0; T; ( H 2 n Hi)'). Now (5.10) is exactly equivalent to (2.1). 

We shall prove the following theorem. 

Theorem 5.2. The pair (A, B) is approximately controllable at any time T > 
0. The range of £(T;v) is dense in ( H 2 n Hi)'. 

Proof. It is clear that it is sufficient to prove that the pair {A, B) is approxi¬ 
mately controllable at any time T > 0. For that we must check the condition 

(4.12)1 i-e., 

rk 

J2(h,w kj )B*w kj = 0, Vfc > 0 => h = 0. (5.15) 

i=i 

This means also 

rk o 

^2(h,w kj )-^-= 0 (h,w kj ) = 0, Vj = 1,... ,r k . (5.16) 

3 = 1 

But from the following lemma we have 

rk 

'^2,(h,w k j)w k j = 0 . 

3=1 


Hence the desired result. 


□ 


Lemma 5.1. Letw be an eigenfunction of the Laplace operator corresponding 
to the eigenvalue X; i.e., 

— Aw = Aw, w\ r = 0; (5-17) 


then one has 



where m(x) = x — xq- 


?n • v dT = 2 A J w 2 dx, 


(5.18) 


Proof. We multiply (5.17) by 

dw 
m a q — 
ox a 

(using summation convention) and perform integration by parts. The desired 
result follows. □ 

2 Given a Banach space X, the notation (7(0, T ; X) stands for (7([0, T\; X). See also 
footnote 2 on page 3 in the Introduction to the book. 
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Remark 5.2. Let To be a part of r. The control is exerted on To only, which 
means that it is 0 on Ti = T — Tq. To treat this case, let us define 


n 0 </> 


d(f> 

dv 


r 0 


Take B = —A 1 Uq. The result of Theorem 5.2 extends to the pair (A, B) 
provided that for an eigenfunction w as in (5.17) 


dw 

dv 


= 0 


r 0 


implies w = 0. From the formula (5.18), it is sufficient that m ■ v > 0 on 
T 0 . □ 


Remark 5.3. From (4.14) again we deduce 


(r T h,h) <cJ2 

k 


1 — e 


-2A k T 


2A k 


< C(INIh-i) 2 . 


i=i 


(5.19) 


Therefore H~ 1 C T^, with continuous and dense injection. Hence also 
Ft C Hq(Q), with continuous and dense injection. It follows that the range 
of £(T;t>), when v lies in L 2 (0, T; T 2 (T)) is dense in H _1 . □ 


5.3 Neumann boundary control 

We introduce some notation. We take 


H = L 2 (n ), V = H\n), A = A — I, 
associated with the Neumann boundary condition. Hence 

D(A) = { 2 €ff 2 (H): !=()}. 

Again D{A) is equipped with the norm \Az\,z £ D(A). The eigenvectors are 
defined by 

—Aw + w = Aw, —^— = 0. (5.20) 

dv 

The first eigenvalue is 1. It is isolated; hence, 1 < A 2 < A 3 • • • and w\ = 
l/y/M- We set m(x) = x — Xq and define 

r 0 = {x £ r: m ■ v > 0}, Ti=T-T 0 . (5.21) 

Let 7 be the trace operator on T. Note the 7 £ C(V; T 2 (T)) fl C(H 2 (Q)-, 
U 1 (T)). Let also uj be the tangential operators on T £ T(iL 1 (T); T 2 (T)), 
such that 
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d<p 
7 Ox, 


dp 


- (Tj J(j) 


verity + yp g h 2 (Q). 


(5.22) 


Note that np = v ■ jDp, and v ■ a = 0. 

Similarly, we define by 70 , 07,0 ( 71 , 07 , 1 ) the respective restrictions of 7 , 07 
to To and Pi. We also use the notation 


D a = {<r u ..., a n ) G C(H\r); (P 2 (P))"). 


The operators 7 , 077 , 027 ,... 07,7 G C(D(A); L 2 (r)) and not identically 
0, whereas n = 0 on D(A). This should be compared with the situation in the 
Diriclrlet case, where 7 , 0-17,0-27, • • -oVi 7 are 0 on D(A) and n is not 0. This 
explains why the analogy with the Diriclrlet case implies the control to be an 
element of U = (i 2 (P))" +1 , instead of just P 2 (P)- The operator B is defined 
by 

P = A- 1 ( 7 *7M7V 2 *...7*<) 

= A-\ 1 * 1 *Dl)&C{U-H). 

We can also view U as (i 2 (Po ))" +1 x (P 2 (Pi))" +1 . Some components might 
be taken equal to 0 ; in which case, they are omitted and we use 7 q or 7 ^ 
instead of 7 * (or a\ 0 , a\ - l ...; D* 0 , D*^). We are now interested in the pair 
A, B. Let us first interpret the dynamic system (5.10), corresponding to this 
pair, 

z' = Az + Bv, z(0) = 0 . (5.24) 

Consider also (5.11), i.e. 

-ft = A(j), (j){T) = h, (5.25) 


then we have 


(z(T),h) 


(B*(j), v) dt 



n 

(rip, v 0 ) + ^( 077 ^,- 17 ) 

*=r 


dt, 


(5.26) 


where ip = A 1 cj) and v = (vq, v\, ..., v n ). As nip = 0, we can also write the 
above relation as 


(z(T),h) 



(5.27) 


where we omit to indicate explicitly the operator 7 . 

Note that z(-) G (7(0,T; H). Let < (t) = Az(t) G C(0,T; (D(A))'). Then 
from (5.27) we deduce 


(C(T)MT)) 



(5.28) 



336 III-1 Controllability and Observability 


Note that if v € (I^ 1 (T)) , and ip € D(A) (hence 7 ip G H 1 (r)), we can write 
< v , 7 ip) = / ^ dr > 


where (i>o, Ui,..., u n ) is a representation of v. 

Therefore (5.28) reads also 

«(T), ip(T)) = f T (v(t), jiP(t)) dt. (5.29) 

JO 

This is exactly the formula that follows from the definition of the solution of 


[C-A( = 0, 

J ac 

I dv 

U(*» 0 ) = 0 


(5.30) 


obtained by the Method of Transposition of J. L. Lions and E. Magenes [1] 
(see also Chapter 2 of Part II), using the dual equation 


! —ip' — Aip = 0, 

% = 0 . ( 5 . 31 ) 

MT) G D(A). 


We are interested in the density of the range of £(T;v), solution of (5.30) 
at some time T, in the space ( D(A )) . This is equivalent to the density of 
z(T;v) in H, where z is the solution of (5.24). We are in the framework of 
the model (2.1), with a semigroup satisfying the condition (4.5), and thus 
the problem is that of the approximate controllability of the pair (A, B) at 
some time T. The general theory implies that the pair {A, B) is approximately 
controllable at any positive time T, if and only if the condition (4.12) holds. 
We write the condition (4.12) 

rk 

^ ~2(h,Wkj)B*w k j = 0 , 

j=i 

This implies that 

rk 

w = J2( h 

t=i 

satisfies 7 w = 0, D a w = 0. Clearly w = 0; hence the coefficients (h, Wkj) = 0, 
for j = 1 ,..., rk- Hence h = 0. 

It is clear from the above that if we control the whole boundary, we can 
take v(t) in L 2 (r ) instead of (l^ 1 (^ , )) , ; i.e., v(t) = vq( t) and v\(t) = ••• = 
v n (t) = 0 . 


Vfc > 0 => h = 0. (5.32) 


Wkj)w k j 
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On the other hand, we need if we control only a part of the 

boundary. Let us make this precise. We first state a lemma. 

Lemma 5.2. The eigenvector w solution of (5.20) satisfies the relation 

I m • v\D a w\ 2 dT + 2{\ — \) f w 2 dx = (A — 1) f m -vw 2 dr. (5.33) 
Jr Jn Jr 

Proof. As usual, we multiply (5.20) by 

dw 

m a ^— 

OX a 

and perform integration by parts. Details are left to the reader. □ 

We then state the following theorem. 

Theorem 5.3. Let A — A — I associated with the Neumann boundary condi¬ 
tion, and the two following cases for U, B. Either U = L 2 (r) and B = A^ 1 7 * 
or U = L 2 (A) x (L 2 (A))” and B = A _1 (yfi 7 lD* a l ). Then the pair (A, B) 
is approximately controllable at any T > 0. The range of £(T;v) solution of 
(5.40) is dense in (D(A))'. 

Proof The first case has already been discussed. Consider the second case. We 
have to prove (5.32). Note first that for k = 1, r*, = 1, and wi is a constant. 
We necessarily have ( h,w\ ) = 0. Starting with k = 2, we have A*, > 1- From 
the hypothesis of the statement (5.32) we have, writing 


r k 

w = 

j =1 

7ou> = 0, D a iw = 0. 


(5.34) 


Splitting the surface integrals in (5.33) in two parts To and A and using 
the sign properties of m.v on /q, A and the fact that A > 1 we deduce that 


/ w 2 dx = 0. 

Jn 

Therefore the coefficients ( h,Wkj ) = 0, for j = 1 ,...,rv The desired result 
has been proved. □ 

Remark 5.4. Apparently, it is not sufficient to take U = L 2 (Pq)\ unlike the 
Diriclrlet case, see Remark 5.2. □ 

Remark 5.5. Consider again (A/*, h). As usual from (4.14), we can prove that 
( rrh,h) < C(\\h\\v) 2 , recalling that V = H 1 . Hence V' C and Ft C V, 
with continuous and dense injection. In the case U = L 2 {r) and B = A - 1 7 *, 
one can obtain an additional result, namely (Z)(A)) C i 7 ^; therefore Ft C 
D(A). It follows that the range of f(T;v), solution of (5.30), is dense in H as 
v(-) varies in L 2 ( 0 , T; L 2 (T)). □ 
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5.4 Pointwise control 

We consider the system 

f C' - = YT=1 Vi(t)S{x - a z ), 

l C| r = 0, (5.35) 

[c(*;0) = o, 

where the points ct; belong to fl and represent actuators. We assume that the 
dimension of the space is n < 3. We shall reduce the formal model (5.35) to 
our general set up. 

We take A = A with Dirichlet conditions. We define 6; £ H by the equation 

0 b i ,h) = (A~ 1 h)(a i ). (5.36) 

This makes sense because for h £ H = L 2 , A _1 h belongs to H 2 C C(fi) 
with continuous injection. Hence the right-hand side of (5.36) is defined and 
represents a linear continuous functional on H. Consider the dynamic system 

m 

z'=Az + J2vi(t)bi, 2(0) = 0. (5.37) 

i=1 

Let us check that 

C(T) = Az(T) (5.38) 

coincides with the definition of (5.35) through the Method of Transposition. 
Indeed consider 

~<j/ = A<j>, <j>(T) = h. (5.39) 

Then from (5.37) and (5.39), it follows taking into account the definition of 6j 

m -t 

(z{T),h) = y2 Vi(t)ip(ai,t)dt, (5.40) 

i= l Jo 

where ip = But from the Method of Transposition we define ((T) by 

[ Vi(t)ip(aii,t)dt. (5.41) 

i=l Jo 

From (5.40) and (5.41), using the fact that ip(T) = A~ l h , we deduce that 
(5.38) holds. Now the system (5.37) has already been studied in §4.2. Consider 
the matrices 

F k , with F ktji = Wkj(ati), j = 1,... ,r k , i = 1,., m; (5.42) 

then we can state the following theorem. 
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Theorem 5.4. The pair (A,B), B = (&i, 62 , • • •, b m ) is approximately con¬ 
trollable at any T > 0, if and only i/rankF*, = ru for any k. 

Remark 5.6. We refer to A. El Jai and A. J. Pritchard [2] for general 
results of controllability in the case of pointwise control. □ 

Remark 5.7. We assume that the assumption of Theorem 5.4 is satisfied. Using 
condition (4.14), we obtain again that Ft C Hq with dense and continuous 
injection. Hence the range of £(T;n) is dense in H~ x . □ 


6 Controllability for skew-symmetric operators 

6.1 Notation and general comments 

We shall need to work here with a complex spectrum. We assume that A has 
a purely imaginary spectrum of the form 

3 = !>• •• } , 

where 

0 < Ai ^ A2 ^ * * * ^ A ^ < • • • , Aj T 00, 

with only a finite number of successive eigenvalues possibly equal. If <pj is the 
eigenvector corresponding to iy/Xj, then (f>j is the eigenvector corresponding 
to —iy/Xj. We assume that 

(6-1) 

form an orthonormal basis of H (complexified). 

This implies with the notation of the scalar product in H complexified 

(sfj 1 fk ) — bjk , (^>j,0fc) — 0. (6.2) 

By definition 

A(j>j = iy/\j(f>j, A<j>j = —iy/\j4>j. (6-3) 

If 0 is an element of H (real valued), then it can be represented with the 

expansion 

<t> = y %2i{ c 34>3+Cj ( t>j), (6-4) 

j 

with 

Cj = ). Cj = l^l 2 = 2 51 M 2 - (6-5) 

j 

It is easy to check that the operator A is skew adjoint, 

A* = -A. (6.6) 

In fact we can even characterize the type of operators we are considering, 
thanks to the following proposition. 
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Proposition 6.1. Assume that A is a linear operator from a dense subspace 
D(A) of H into H, satisfies (6.6) and 

the null space of A = {0}, 

the mapping A + I from D(A ) to H is onto 
(and thus invertible since already one to one), 
and the map T = (A + I ) -1 is compact. 

Then the spectrum of A is of the form ±i y/Xj, with 

0 < Ai ^ A2 < Xj < * * * , Xj T 00, 

and the corresponding eigenvectors <pj and 4>j form an orthonormal basis for 
H. Conversely if A has these spectral properties, then it satisfies ( 6 . 6 ) to (6.9). 

Proof. Let us assume ( 6 . 6 ); then if z € D{A), we can write 
( Az,z ) = — [A*z,z) = —( z,Az ) = —(Az,z), 


(6.7) 

( 6 . 8 ) 
(6.9) 


and thus ( Az , z) is purely imaginary. Hence the eigenvalues are necessarily 
purely imaginary. As —1 cannot be an eigenvalue, the map A + I is necessarily 
one to one. Moreover if A is an eigenvalue corresponding to the eigenvector <j>, 
then </> is an eigenvector corresponding to the eigenvalue A. 

Assume now (6.7), ( 6 . 8 ), and (6.9). Let us check the T is a normal operator 
on H ; i.e., 

T*T = TT*. (6.10) 

Note that T* = (A* + /) -1 . Let / £ H and define 


& — \{{A + I) 1 f + {—A + I) 1 /}, 

^ = (A + I) 1 f + (—A + I) 1 /}; 


then clearly if = A<f>; thus 

A0 + </»=(A* + /)- 1 /, A* <f> + cj>= (A + /) -1 /, 


which proves ( 6 . 10 ). 

From the spectral theory of normal compact operators, see T. Kato [4, 
p. 260], we can state that T has a discrete spectrum {/a 1 ,yu. 2 ,---}, where 
|/xi| > I/X 2 I > • ■ • > \p n \ > • • •, |/r n | tends to 0 as n tends to infinity. Each of 
these eigenvalues has a finite multiplicity. Moreover, as the null space of T is 
0, the eigenvectors form an orthonormal basis of H. But eigenvectors of T are 
eigenvectors of A , with eigenvalues obtained by the transformation 


A — —1 + l//x. 


The spectral properties of A are easily deduced. 
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Let us check the reverse. The set D(A) is made of elements 

(f) = + Cj(f>j) 

3 

such that 

£ i c jI 2a j < °°- 

3 

It is clear that D(A) is dense in H. If cf> £ D{A ), then 

a<i> = y “I - \/ r \j ( i ) j)- 

3 

Therefore we can solve the equation 

A<j> + <t>=f ( 6 . 11 ) 


as follows: 

c ._ u 

3 (i -iv^y 

where f 3 denotes the components of /. Therefore, (6.11) has one and only 
one solution. To prove (6.9) consider a sequence {/"} that tends to 0 in H 
weakly, and let (j) n be the corresponding solution of (6.11); we must prove 
that (j) n tends to 0 in H strongly. Let /" be the components of f n and 

fn 

c n __ j J 


be the corresponding components of (f> n . 
We have 


£KI 2 = £ 


l/”l 2 

l + A, 


< £ i/;i 2 + 


in 2 


As /" tends to 0 weakly, |/"| 2 remains bounded and /" tends to 0 for any 
fixed j. Moreover A„ tends to 0 as A tends to infinity. It follows from the 
above inequality that 

£| C £ 

3 

tends to 0 as n tends to infinity. This means that <j) n tends to 0 in H. □ 

The solution of 

z' = Az, z( 0) = (j) (6-12) 


is given by 


z(t.) = e tA (j) = J2( c o e 
j 


(6.13) 
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where Cj are the components of <fi. 

In the sequel we shall use the notation 

(j> = Re cf> + i Im <f> 

to express the decomposition of an element of H complexified. 
Note also that if <p £ D(A), then 

W\\d(A) = \M\ 2 = 2^Aj| C j| 2 

3 


and 

fa fa 

\Aj y/\j 

form an orthonormal basis of D(A). Similarly <f>j y/Xj, fay/fa form an or¬ 
thonormal basis of (D(A)Y. 


6.2 Dynamical system 


Consider B £ C(JJ;H). We shall make several assumptions on B in relation 
with the eigenvectors (f>j. 

There exist N integer > 0 and operators M € C(H-H), A £ C(H- D(A)') 
such that 

\B*z\ 2 > (Mz,z), Mz£H , (6.14) 

for all j, k > N + 1 , 

(M Re cpj ,1m cf>k) = 0, (6.15) 

for all j, k > N + 1 , j ^ k 


(. MRe(f)j,Re(fik ) 


(A Re4>j,Recj)k) 
A k 


(A Re (f>k , Re < j)j ) 

7 


(6.16) 


for all j, k > N + 1, j ^ k 


(ARe(f)j,Re(j>k) + (ARe0k,Refa ) + y/\j\k(M Im ^, Im </> fe ) = 0. (6.17) 


There exists cq > 0 such that for all j > N + 1, 


(MRe<f>j,Re<t)j) + (MIm</>j,Im</>j) > —, (6.18) 

Aj 


for all j > N + 1 


Re <j)j , Re <j>j ) — (M Im <f>j, Im < fij ) 


( ARpA, 


< 


K 

77 


(6.19) 


and 
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Ajv+i > Aat. 

For j < N, we consider only the Xj having different values and call Pj(Pj) 
the projector on the finite dimensional eigensubspace of H corresponding to 
the conjugate pair of eigenvalues {i-^/Xj, — iy/Xj}\ then 

\B*P jZ \ 2 > ci^pL, \/z € H, j < N. (6.20) 

A j 

With our convention we have 


0 < Ai < A 2 < • • • < Ajv < Ajv+i < Ajv+2 ^ 
An element </> of H is represented by the expansion 


N 


j =1 


E ( 

j>N+l 


Cn(, 


/)• 


( 6 . 21 ) 


Naturally if N = 0, the condition (6.20) is void. 

We now consider the dynamic system corresponding to the pair (A, B ) 


z' = Az + Bv, z(0) = 0. 


( 6 . 22 ) 


Our main result is as follows. 


Theorem 6.1. We assume that A satisfies (6.6) to (6.9) and B satisfies 
(6.14) to (6.20); then the pair (A, B) is exactly controllable at T, for T suffi¬ 
ciently large. 

Proof. We shall consider the controllability operator 

r T 

r T = e tA BB*e tA dt. 

Jo 

and prove that 

V/i G H, ( r T h,h ) > c T \\h\\l D{A)) , (6.23) 

for T sufficiently large. 

According to §3.2, this implies the desired result. Consider 


N 

h = E ]( p jh ~b P jh) + El ( c El + Cjfy) 

1=1 i>JV+l 


with Cj = ( h,4>j ); then 


(. r T h,h)= [ \B*e tA " h\ 2 dt 
Jo 


= 4 


N 


B* ( Y,M etiV ^P j h)+ E R e{e~ u ^c^j) 

1=1 j>N+ 1 


dt 


= X 1 + X 2 + X, 


(6.24) 
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where 


Xi =4 


B* 


N 


E Re (< 


—ti \/A 


h) 


X 2 = 8 B* 


y=i 

N 


53 R eie^^PjH) 


j =i 


dt , 


, B* 


53 Re{-~ u ' /x 
j>N+l 


e 


X, = 4 


R* 


E Re ( 

j>AT+l 


e-W’Cih) 


dt. 


By an easy computation 


N 


X 1 =2TJ2 \B*P j h\ 2 + Y l 

3 =1 


with 


JV 


i p — ^(y^J+x/AT) 

Yi = 2 Re Y, (B*Pjh, B*P k h) 

j~kti HV A i + V Afc) 


JV JV 


_ _ 1 _ e 

+ 2 R eYY( B * p ^ B * p « h )—nr — 

7=1 [ *(v%-v A fc) 




JV 


1 — e 


— iT(\/\j + 


dt. 


X 2 = 2Re^ 53 (. B*P j h,B*<j )k c k ) ' 

J=l fe >V+i *(V A i + VAfc) 

* _ _ ! _ e -«VA7-V*id 

+ 2Rc E E (B*Pjh, B*ej) k Ck) - 7 =—. 

7=1 fc>V+i l W X 3 - VAk) 

Now according to (6.14) 

-A 3 > 4 f T l M l E ^(e-^c^)] , ^ Re(e- ti V / Nc)^) 


dt. 


j>N+l 


At this stage it is convenient to introduce the following notation, which will 
help reduce the length of the following equations and estimates: 

iriij = (M Im <f>i ,Im <j>j ), Uj = (AR,e(j>i,R,e(j>j). 


From (6.15) 
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X 3 > 4 ^2 / (MRe^>j,Re</)fc)Re(e u v^Cj) Re(e u '^Ck)dt 

j,k>N + l^° rp _ 

+4 ^2 f rnjk{e~ u ^Cj)Im.(e~ u ^c k )dt, 

j,k>N+l 1 '° 


and from (6.16), 


X 3 -f 4) + Z 3 , 


where 



Z, = 4 


E 

k>N+l' 


ljk_ 
A k 


+ 


Ikj 


Re(e u v Ai Cj) Re(e 




Ck ) dt 


+ 4 ^ / TOjfcIm(e Im(e u '^Ck)dt. 

fc>AT+l"'° 


Set 



Then we can write 


Z 3 /4 = 


E 

fc>]V+l 

j^k 



Ijk \/A ~j 
\/Afc 


hjv^k 


r e ( e -«v^ a -) Re(e" tlv/ ^ a fc ) dt 


+ ^2 / i/AjAfem^fc Im(e ^V^a, ) Im(e tl '^ak)dt. 

k>N+l 

j^k 


Then 


■^3 =-4 ^ f -E=E m ( e tl V^aj) Re(e tl ^a k )dt 
fc>JV+l"' 0 ^Afc 
j^k 

-4 V / r ERe(e-«^ a -El m ( e -‘>^)d i 

fc>iv+i •'° V A i * 

j^k 


+ 4 ^ / \/AjAfc mjfe Im(e t *V / ^"a J )Im(e tl '^ak)dt. 

k>N+1 1 '° 
j^k 
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Integrating by parts and using (6.17) obtains 


Z 3 =-4 £ (ARC J,^ fa) ( lm{e iT^x - al} , Re(e .T^ a - ;) 


k>N+l 

jAk 




- Im (aj) Re(afe)) 


-4 J2 (ARe ^ e ^ (lm(e iT ^a k ) ■ Reje^aj) 
V j - Im(dfc) Re(aj)). 


k>N+l 

iAk 


Hence also 


Z 3 = — 8 A ^ Re0jlnr(e lT '/u"o J ) j , ^ Re( 


Re(e- lT ^a fc )\ 


\j>N+1 


fc>iV+l 


x/Afc y 


yl ^ Re</>jlnr(aj) I , ^ Redtfc—-== 

\ - / fc>N+l ^ Afc 


Re(afc) \ 


0> JV + 1 




xRe(e lT v x i aj ) 


+ 8 ^ (ARecfij, Recfij) Inr(e * T \A( aj .) 

j>iv+r V A i 

— 8 ^ (H Re cf)j , Re </>j) Im(d)) Re |(j() . 
i>iv+r V A? 


i>JV+i 

Next as easily seen 


F 3 = 2 T ^ |c j | 2 ((MRe^,Re^) + (MIm^,Im^))+F 3 , 

j>N+l 


Im( C 2(e 2iT vN _ 1)) 


x/Ai" 


with 

*3 = {( M Re & ’ Re ) _ m n I 

i>iv+r 

Collecting results we deduce that 

N 

(r T h,h)>2Tj2\B*Pjh\ 2 + 2T ^ c, 2 i.U lleo,. Reo.,) - m,/ 
i=i j>iv+i 

+ Yi + X 2 + Z 3 + Y. (6.25) 

Using the assumptions (6.18) and (6.19) we get, setting c = min{co,Ci}: 

\Pjhf 


(Prh, h) > cT E 


. i=t 


A, 




- H 1°: 

y>iv+i 

> cT\\h\\f D{A)y + Y 1+ X 2 + Z 3 + Y'. (6.26) 
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We now estimate the remainder +Y\ + X 2 + Z 3 + Y 3 . 
We first check 


Vi+X 2 


= 2 Re 


N N 

Y J BB*P j h,Y J 

3=1 


1 


E 

fc>AT+l 


\ — e i7’(v^\rtVW) _ ^ _ g— s/\k) 

Pkh - —= -—-b Pkh - , _-=— 

*(\/E + V / Afc) *(\/E — 

. (6.27) 


l _ g-* T (vW-VW) _ ^_g-*r(y / A7-v / A7) 

— 7 = _— b^feCfc — 7 = _— 

HVAi + V Afc) Hv W ~ v Afc) 

|W + X 2 \ < /?iv|l^ll(r>(A))'> 


N 


@N = EsupJ^ vEAi 


Hence 

where 

and 


•\?+i A 
We interpret \j-i = 0, if j = 1. Now 


(6.28) 


i=i 


\BB*P 0 h\ 

\Bjh\ 


j A^ 2 i(Aj + Aj + t) 1/2 X^iXj + Xj-i) 1/2 

Ai = max { —— T - T -, —— 7 - 7 - 

Aj Aj—i 


Z 3 + Y 3 = T 3 + Tg, 


where 


T S = -8 ( A ( £ Re* Im(e-‘ T ^a,) ) , £ 

11 1 V Ak 

Re(dfc) \ 


U>JV+1 


fc>]V+l 


+ 8 yl ^ Re^-Im(aj) , ^ Heo,,—=E 

\ \ j >N +1 / fc>W+l ^ Afc / 


and 


T 3 = E] ] (Af Re 4>j j Re <pj ) — (Af Inr <f>j , Im <f>j ) — 4 

j>Af+l 


(rlRe^j Re^j) 

A” 


Ini(d(e /Ij v* — 1)) 

E7 ' 


As A G £(H; (D(A)) , ) and using the fact that 


vE vE 



348 III-1 Controllability and Observability 


are orthonormal in D(A), we can write the estimate 

\T 3 \ < 4P|| \\h\\f D{A)y . (6.29) 

Similarly thanks to (6.19) 

\n\<K\\h\\l D{A) y. (6.30) 

From (6.26), (6.28), (6.29), and (6.30), we deduce the desired result. □ 
Remark 6.1. We have proved that 

(r T h,h)>c(T-T 0 )\\hf mA)y 

with 

^ _ 0 N + K + 4\\A\\ 

4o — -, 

C 

where c = min(co, Ci) (= Co if IV = 0). Therefore there is exact controllability 
if T > To. Moreover this estimate implies the sequence 

D{A) C F t C H C F' t C {D(A))' (6.31) 

with continuous and dense injection, as seen in §3.2. □ 

Remark 6.2. In finite dimension, Theorem 6.1 reduces to Proposition 4.2. □ 

There is some flexibility in the type of assumption we can make to achieve 
exact controllability. We give next a variant of Theorem 6.1. 

Theorem 6.2. We make the assumptions (6.6) to (6.9), (6.14), (6.15), (6.20), 
and 

BB* € C((D{A))'-D{A)) (6.32) 

and Vj, k > N + 1, j ^ k 

XjXk(M Re0j,Re</>fe) = (/lRe^Re^*,) + (ylRe<(>*,, Re^-). (6.33) 

There exists Q £ T(H; H) > 0, self-adjoint such that V), k > N + 1, j ^ k 

(ARecfj, Recfk) + (A Re </>&, Re 4>j) 

\k X j 

+ \JXjXk(M Im cfj , Im (f ) k ) = (Q Re 4>j, Re 4> k )- (6.34) 

There exists Co > such that \/j>N+l 

( MRe(pj,Re<f>j ) + —jtll > _£. j (6.35) 

■i \ 


and Vj, k > N + 1, 
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(M Re ( pj , Re < fij ) — ( M Im <f>j , Im (j>j ) 


(QRecj)j, Refj) ARe<j)j,Re(f)j) K 


< 73 72 ' ( 6 - 36 ) 

.7 


T/ien £/ie pair (A, B) is exactly controllable for T sufficiently large, and 
D{A 2 ) C Ft, with dense and continuous injection. 


Proof. One proves that 


(Frft., h) > ct||^||(ti(a 2 ))') V/i € if. 


(6.37) 


Of course this estimate is not as good as (6.23), but it is sufficient to establish 
that (r T h, h) is a norm on H and the rest of the statement. We again write 


(. r T h , h) = X! +X 2 + X 3 , 


where 


z 4 J 0 B * \^ 2 Re ( e ~ u ^ p J h )j dt . 

= 8 J (b* ^Re(e- ti V / ^’p j F) N j ,B* l ^ Re(e- U ^ Cj<pj)\ dt, 


X 3 =4 J B* I Re(e _ti V^Cj0j) J dt ■ 


j>N +1 


As in Theorem 6.1 


Xi = 2T^ \B*Pjh\ 2 +Yi. 


We can combine 


X 2 + Yi = right-hand side of (6.27). 


We can state the estimate 


where 


\X 2 + Yi \ < /3jv||/i||(D(A 2 )) / ) 


a _ /7 BT a \\BB*Pjh\\ D ( A ) 


(6.38) 


(6.39) 


(6.40) 


and 
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A I ^j+i (A? + ^j+ 1) 1/2 1) 1/2 

yL = max < —— 


l ^j+i fa fa fa- 1 

Moreover again as in the proof of Theorem 6.1. 

* 3 > 4 £ f {MRefa,Refa)Re{e- u ^Cj) • Re(e _ti ' A *Cfc)dt 

j,/c>JV+l 

+ 4 ^ f (Mlm.(f>j,lm(f)k)lm(e~ u '^Cj) ■lm(e~ u '^Ck)dt. 

j,k>N=l 

Let us write bj = Cj/Aj; then from (6.33) 

-X 3 > Y 3 + ^ 3 , 

where 


Y3 = 4 51 / A|(MRe</> j ,Re^)|Re(e“ ti \/^6 j )| 2 ^ 

j>JV+l •'° 

+ 4 ^ f X^(M lm fa,Im fa)\lm(e~ tl '<^bj)\ 2 dt, 

^\Afi 1 ''O 


(6.41) 


j>N+l * 


^ 3=4 ^ J ((ARefa,Refa) + (ARefa,Refa)) 
bj^k 1 ■ Re(e~ u V^bj) Re(e~ tiVX *b k ) dt 

( T 

+4 '^2 / Xj\k{M lm(f>j,lm(t)k) 

fc ^ fc +1 J ° ■ lm(e~ u ^bj) hn{e~ u ^bk) dt. 


(6.42) 


We can write 
cT 


/ 0 


((21 Re fa, Re 0 fe ) + (/I Re 0 fc , Re <^)) • Re(e" ti v / ^6 i ) Re( e -W^ &fe ) dt 


fa 


= — I yl Re fa , Re ' r fa. ) (Re(e Tl ^^bj) ■ Im(e Tls ^bk) — Re&j Imfe^) 
V v Afc / 

— ^ylRe^fc, Re (Re(e~ Tlv/ ^6fc) • Im(e _T *V^6)) —Refefc Im6)) 

' >T / (ylRe(/>j,Re())fe)y / A7 (ylRe^Re^-v/Afc^ 


+ 


/o 


V%c" \/Aj 

• Im(e _t *V^"fy) Im(e _t * v/ ^&fc) dt 
and thus from the assumption (6.34) 


(6.43) 


Z a = -8 A 


]T RefaRe(e- Ti V^bj) 

j>N+l 


, Y, Re^Im (e~ Ti ^b k ) 
V Xk 


k>N+l 
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, Re-^Im(6 fc )] 

k>N +1 ) 


+ 8 | A ^ Recj)jRe(bj) 

j>N+l 

+ 8 y f^Re^,Re-^=VRe(e“ Ti ^6“)Im(e“ Ti ^6“) 

j>N+1 A V ' 

— Re (bj) Im(6})) 

+ 4 f J Q ^ ' y/Aj Re <j>j Im(e ), 

•'° \ i>Af+i 

y, Re (j>k Im(e _Tlv ^6fc) 

A;>iV+l y 

— 4 f y Aj((5Re0j,Re^>j)| Im(e _t *V / ^"^)| 2 dt. (6.44) 

"'° j>iv+i 

Since Q > 0, we can assert that 

X! + x 2 + x 3 


N 


> 2T ^ J2\ B *Pjh\ 2 + y |& J | 2 [A J 2 ((MRe<( )i ,Re^) + (MIm^ ) Im^)) 

. i=i j>N+i 

— Xj (Q Re c/)j, Re <f>j )] ^ + Yi + X 2 + /ii + /i 2 , (6.45) 


with 


Z\i = y < A^ 2 [(M Re 4>j , Re < t>j ) — (M Im , Im tpj )] 
7>at+i l 


+Aj /2 (Q Re cf)j , Re </>j) - 4 ^ Re y e ^) 

X 3 


Im (6 2 (e 2T V A t _ 1)), 


A 2 = -8\A y Re</) J Re(e- Ti v /A 7& i ) I , y Re -^L Im( e - Tiv ^6 fc )) 
* * v Afc 


j>AT+l 

+ 8 fyl 


/C>JV+1 


y Re^Re(6j) 

j>iV+l 


y Re -7=Im(6fc)- 

_l i V A/c 


fc>iV+l 


Then, according to the assumption (6.36) 

|z\l| < A ll^l|(D(A 2 ))' 


and 
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|^ 2 |<4P|| \\h\\f D{A2)y . 

Then we deduce from the assumptions (6.20) and (6.35) 

(r T h,h)>c(T-T 0 )\\h\\ 2 {D{A2)y , (6.46) 

with c = min{co, ci} (co if N = 0) and 

^ p> N + K + 4\\A\\ 

J-0 ~ -5 

c 

and the desired result has been proved. □ 


6.3 Approximation 


We shall study the properties of TV, assuming only ( 6 . 6 ) to (6.9) and thus 
nothing on B except naturally B G C{U ; H). 

We now keep only the eigenvalues with different values denoted 0 < Ai < 
A 2 • • • < A j < ■ ■ ■ and call Pj the projector, which has been defined in ( 6 . 20 ) 
(but now j is any integer). An element </> of H is represented as 

4> = Yl(Pi<t> + Pj4>) (6-47) 

j 


and 


e A V = + c 'v^/'-o). 


Cah _ 

n N ct>= Y (Prf + Pit)- 

We also define the operator r by 

r = 2 Re 'Y p : j BB * Pj ■ 


We can state the following proposition. 
Proposition 6.2. Assume ( 6 . 6 ) to (6.9); then 


rrh 

— 


rh 


in H, 


V/i G H, 


as T 


Proof. We can write, picking 77 in H 


(6.48) 

(6.49) 


(6.50) 


(6.51) 


N 

(r T h, rj) = ( r T {h - n N h),Ti ) + 2TReY( p j BB * p i h ^) + Xn,t + Y N>T 

i=i 


(6.52) 
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with 


N 


( l - e ~ iT {\/>^+V^k) 

X N , T = 2 Re ( Y, BB*PjK Y < Pki 1— 

\j=l k ^3 v 


*(\/^7 p v^fc) 

+Pki1 —77 


and 


N 


Y NyT = R eY( BB *Pjh, PjV) 


3=1 


*(\Z-\i" v^) 

— e 2ir \Ai') 


We can check that 


\X NiT \ < f3N\\h\\( D ( A )y\\v\\( D (A)y 


where /3n has been defined in the proof of Theorem 6.1. 
Similarly 


N 


\Y N , T \<V2Y\ BB *Pjh\: INI (D(A)y. 

3=1 


(6.53) 


(6.54) 


Now 


N 


2T Re (Pj BB *Pjh,rj) = 2T(rh,r]) - 2T(r{h - n N h),rj). 

3=1 


Therefore, collecting results, we deduce noticing that ||/r|| < T||RR*|| and 

\\ r \\ < \\ BB *\\ 


— ~r\h 

T 


M 0N\\h\\( D ( A )y + V2JY, \BB*PM 

< 2\\BB *\\: |h - n N h\ + " " ( ( )} - ^ J ~ 1 ' - J —. 

T Ai 


and the desired result follows. □ 

We next prove the following estimate. 

Lemma 6.1. 


|(/tM)I < \\ BB *\\m +T\\h\\ D{A) )\\ V \\ {D{A) y. (6.55) 

Proof. From the definition of I\ we have 

{Prh,v) = 4^ ^RR*^Re(e^P ; /i),^^Im^ e ^^^j dt , 


and by integrating by parts 
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= 4 


BB* ]T Re(e iT V / ^P J /i), ^ Im ^e iT ' A » j 

-4 ^P*^Re(P j /t),^Im (^) j 
+4 f (bB* Y^ Im( P, /i), ]T Im 


r T 

70 V 


:Ptfi 
V^k 


Thus the result (6.55) is easily deduced. 
One deduces from (6.55) that 


dt. 


□ 


r T G C(D(A)-,D(A)). 


(6.56) 


Remark 6.3. The formula used in the proof of Lemma 6.1 shows also that that 
if BB* G C(D(A)-,D(A)) , then 

r T €C(D(A 2 );D(A 2 )). 


□ 


Similarly we check the estimate 

\(rh, V )\<\\BB*\\: \\h\\ D{A) \\ V \\ mA)y , (6.57) 

and then we can assert the following proposition. 

Proposition 6.3. One has 

-jrh ==>■ Rh in D(A), V/i G D(A), as T => oo. (6.58) 

Proof. Using the formulas of Proposition 6.2 and Lemma 6.1, we obtain easily 
the estimate 


^-r\h 

T 


D(A) 


< 2 ||pp*|| \\h-n N h\\ D(A) + 


\h-n N h\ 


T 


0N\\h\\( D (A)) 


N 


T 


-b+V2^2\BB*P j h\, (6.59) 


isl¬ 


and thus (6.59) follows. □ 

We now make the assumptions of Theorem 6.1. We first notice that (P/i, h) 
is also a norm on H , thanks to the following proposition. 

Proposition 6.4. We make the assumptions of Theorem 6.1; then 

(■ Ph , h) > c\\h\\f D{A)y Vft G H. (6.60) 
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Proof. We have 

(. rh,h ) = 2^2(\B*RePjh\ 2 +\B* ImPjh\ 2 ), 
j 

and from (6.14) and (6.20) 


^ |p./i | 2 

>2 ((MReP j h,ReP j h) + (MImP j h,lmP j h))+2c 1 J2^-^- 

j>N +1 j=l i 

Now (6.15) to (6.17) imply that if 

rj 

Pjh = 'Y. c jk<t>jki 

fe=i 

then 

((M Re Pjh, Re Pjh) + (M Im Pjh, Im Pjh)) 

j>N +1 

r i 

= E E \ c jk | 2 ((M Re <f)jk , Re <j)jk) + (M Im Im<j> jk )), 

j>N+1 k= 1 


and from (6.18) 


^ c ° E E 


I c jk | 


j>iV+l k =1 


\ ' l-Pj^l 2 

0 E -*—• 

j>JV+l J 


Therefore collecting results, the desired result follows. □ 

Let us define the space F’ completing H with the norm (6.60). Clearly one 
has as for (6.31) 

D(A) CF CH CF’ C (. D(A ))'. (6.61) 

As TV is invertible from F' T to Ft and r from F' to F , we can consider (TV) -1 
from Ft to F.'f and T _1 from F to F', hence also from D(A) to ( D(A))' for 
both. 

In fact, it will be useful to notice that something more can be said for 
T -1 , namely the following lemma. 

Lemma 6.2. 

r~ l g c(d{a 2 )-h). 

Proof. Setting <j> = r~ l h; then from the definition of r 


2 Re ^ p j (■ BB*Pj<j)) = 2 Re Y Pjh; 
j j 



356 III-1 Controllability and Observability 


hence 

Pj{BB* Pj(f)) = Pjh, Vj. 

Therefore 

\B*Pj4\ 2 = (Pjh,Pj4>), Vj. 
But from the proof of Proposition 6.4, it follows that 

\B*P j( j>\ 2 > c^L. 

A? 


Therefore 

\m < ^\m- 

Hence 

l</>| 2 = 2^|P,0| 2 < ^ ^2 \j\Pjh\ 2 < - c \\hf D{A2) , 
j j 


which is the desired result. □ 

We can then state the the following theorem. 

Theorem 6.3. We make the assumptions of Theorem 6.1; then one has 

T(r T )~ 1 h => r~ 1 h in(D(A))', Vh € D(A). (6.62) 

Proof. Let us set px = and p = r~ 1 h. 

We begin by proving the weak convergence in (D(T)) . But 


(h,PT) 


Bf . 

-jtPt, pt ) > c 


T-Tr 


T 


-WptWUaw 


and thus 

2 

\\pt\\(d(A))' < ~\\h\\ d(A) 

as soon as T > 2 T 0 . 

Therefore we can extract a subsequence converging weakly to some a in 
(D(A)) . But we can write for any rj in D(A) 


^jrVyPT^J = (M), 

and using Proposition 6.3 we get 

(Bp, a) = (h, rj). 


Therefore 


(r(cr - p),n) = 0 
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for any 77 in D(A). Hence T(a — p) = 0. But T is invertible from (D(A))' to 
D(A)-, hence p = a. Note that by the uniqueness of the limit, we can assert 
that the full subsequence converges. To prove the strong convergence, we first 
assume that h £ D(A 2 ); in which case, we know that p belongs to H. But 


Tt 

~T 


r T 

(pr p) 1 Pt P J = 0, PT ) - 2 (h, p) + ( — P, p 


and therefore the right-hand side tends to 0. It easily follows that pr tends 
to p in (D(H)) . In the general case, we pick a sequence h lt that belongs to 
D(A 2 ) and converges to h in D(A). Let p M and pr^ correspond to h lt . We 
first notice that 

II PTfi - Pt\\ < -|| h - /i m ||d(A)- (6.63) 


Now 


||pr - p\\ < II PTn - Pt\\ + II pTy, - Pn II + II^V _ p\\- 


From the uniform estimate (6.63) and from the fact that \\pth — P ^|| tends 
to 0 as T tends to infinity and p, is fixed, we deduce that px tends to p in 
(D(A)Y as T tends to infinity. □ 


6.4 Exact controllability for T arbitrarily small 

In this section, we consider additional assumptions, which will guarantee that 
the pair ( A , B) is not only exactly controllable for large T, but in fact for 
arbitrarily small T. We work in the framework of Theorem 6.1. We replace 
(6.19) by 


(M Re (j>j , Re 4>j ) — (M Im <pj , Irn (j)j ) — 4-^— — ’ — iftil 

< Vj>N+ 1. (6.64) 

In fact, we shall need (6.64) for j sufficiently large, but modifying the constant, 
we can always assume that it is satisfied for j > N + 1, without loss of 
generality. We also assume that 

there exists a Hilbert space W such that D(A) cWcH, 

the injection of D(A) in W is compact, and r £ C(H-, W'). (6.65) 

Our objective is to prove the following. 

Theorem 6.4. We make the assumptions of Theorem 6.1, except (6.19), 
which is replaced by (6.64), and we assume (6.65). Then the pair A, B is 
exactly controllable for any time T > 0. 
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Proof. We begin by proving that for any T > 0, then 

(r T h, h) = 0 => h = 0 . (6.66) 

This will imply that (Prh, /i ) 1 / 2 is a norm on H , for T > 0, arbitrary. 
Of course, we already know that it is true for T > Tq. Naturally ( 6 . 66 ) is 
equivalent to 

r T h = 0 = 4 - h = 0 . (6.67) 

We denote by P1 J the projector on the subspace of H , generated by the 
eigenvalues with j < J. We shall need to consider only J large, so in 

particular J > N; hence for any element h of H, one has 

N J 

n J h = J2(Pj h + Pjh)+ Y Pj°.i ■ ( 6 - 68 ) 

3 -1 j-N+1 

We shall prove that for any T > 0, there exists J depending on T, sufficiently 
large and a constant (3 J , such that 

(r T h, h) +p J \II J h\ 2 > c T \\h\\f D ( A) y, VheH. (6.69) 

Assume for a while that this is proved. 

We shall then prove that 


r T h = 0 implies h £ D(A). (6.70) 

Indeed, from the assumption we have 

B*e AH h = 0, t€(0,T). (6.71) 


Let r such that T — 2t > 0. Consider a sequence of C°° functions on R, 
with compact support on (0, r), denoted by pj, which converges to <5(0) in the 
distribution sense. Define successively hij and by the formulas 


hij = e A S hpj(s) ds, 

Jo 

h-ij — / e h\jpj(s) ds , 
do 


then hij £ D(A), h 2 ,j € D(A 2 ). 
Indeed 


Ahip = / e A S hp'j(s)ds, 

Jo 

Ah 2 ,j = f e A S hijpj(s) ds. 
Jo 


(6.72) 

(6.73) 


From (6.71), we deduce easily 
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B*e A * t hij = 0, t £ (0, T — r), 

B*e AH h 2 ,j = 0, t £ (0,T — 2r). 

As fi 2 ,j £ D(A 2 ), we deduce by differentiating twice the second relation that 
B*e AH A 2 h 2tj = 0, t £ (0, T — 2r). 

Moreover A 2 h 2 j £ H. Therefore, we may apply (6.65) with h = A 2 h 2 j, and 
T changed into T — 2r. As rT- 2r A 2 h 2 j = 0, we deduce that A 2 h 2 j remains 
in a bounded subset of (D(A)) ; hence h 2 j remains in a bounded subset of 
D(A). On the other hand, h 2 j converges to h in ( D(A )) weakly. This follows 
from the fact that if <f> £ D(A), then 

(<j>, h 2 ,j)^[A + I]J e As 4>pj(s) ds, [A + /] _1 J e A S hpj{s)ds 


and 


[A + I] 1 e A S hpj(s)ds 
Jo 


tends to h in H strongly, and 

[A + I] f e As 4>Pj{s) ds 

Jo 


tends to (f> in H weakly. Therefore h £ D{A). 

Let Y be the subspace of H of elements such that h £ H, BtH = 0. Our 
objective is to prove that Y = {0}. We first prove that Y is finite dimensional. 
But if h £ Y, then one can write 


r T h + (3 J II J h = f3 J n J h; 


hence 

h = (3 J (r T + (3 J n J )~ 1 n J h 

and 

n J h = p J n J (r T + p J n J )~ 1 n J h. (6.75) 

These formulas prove that Y is a vector subspace of the span of (Ft + 
(3 J n J )~ 1 <j>j, (It + (3 J Ft J )~ 1 (f>j,j = 1,..., J, where we have written for sim¬ 
plicity II J in (6.75) as 


J 

II h = 'y ' (cj(f>j + 
j=i 

which is always possible by a convenient renumbering. 

Now, thanks to (6.70), Ah £ Y. Furthermore, if h £ Y, A 2 h £ Y and thus 
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r T A 2 h = (3 J n J A 2 h = (3 J n J A 2 h 

and also 

(. r T A 2 h , A 2 h) + (3 J {n J A 2 h } A 2 h) = /3 J {n J A 2 h, A 2 h). 

Therefore, by (6.69), we deduce 

c T \\A 2 h\\ 2 D{A)y <P J (X J ) 2 \h\ 2 

or 

°T\Ah\ 2 H < (3 J (\ J ) 2 \h\ 2 , 

which proves that A is linear continuous on Y. But then Y can be spanned 
by the eigenvectors of A. If <f>j is an eigenvector of A belonging to Y. then 

= Vfe(0,T). 

By the analyticity property, it follows that 

B *= 0, Vi G (-oo, +oo). 

In particular (rr<j>j,<t>j) = 0, VT > 0. This is impossible, because we know 
that for T sufficiently large (T 7 V 1 , /i ) 1 / 2 is a norm on H. Therefore Y = {0}, 
and (6.67) is proved. It is easy to check then, as a consequence of (6.67) and 
(6.69), one has also 

(r T h,h) > c' T \\hf {D{A) y, VheH, VT>0. (6.76) 

Suppose that (6.76) is not true; then there exists a sequence {h n }, ||/i n || (d(A))' = 
1, such that (Tr/im hn) tends to 0. As (Tr/i, h) 1 ^ 2 is a norm on U, we have 
h n —> 0 in Ft (completed of H with the norm (Irh, h) 1 / 2 ). As h n is bounded 
in (Z?(A)) , it converges also weakly to 0 in (D(A)) ; hence, IPh n —* 0. But 
then from (6.69), ||/i ra ||(D(A))' ~> 0, which is impossible. 

It remains to prove (6.69). It is sufficient to prove that 

VT >0, 3J = Jt and ct such that 

(r T (h-n J h),h-n J h)>c T \\h-n J h\\ 2 {D{A) y. (6.77) 

Now 

(. r T (h - n J h),h - n J h) = 4 / 

Jo 

and with calculations already done 

> 2 T ||cj|| 2 ((MRe^,Re 0 J -) + (AfIm 0 j,Im 0 J -)) +^3+^3, 

j>J +1 


B* | Rc ( € 
j>J +1 


1 c j4>j) 


dt 
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with (recalling that a,j = 


Z 3 = -8 A 


+ 8 A 


y~* Re (f>.j Im(< 
i>^+i 

Re (f> : j Im(c 

3>J +1 




a j) 


Re(e lT ^a fc )\ 


, <rK /\~ I 

k>j+1 ^ Afc ) 


fc >j+1 / 


8 ^ (ylRe^,Re</>j)Im(e * T \A*aj)^^——=■— 
i>J+l V A i 


— 8 ^ (A Re 4>j , Re <pj) Im(aj) 

,>j+i V A J 


and 


Im(c((e 2,T v A t — 1)) 

F 3 = 5Z [(-^ Re <t>j > Re (j)j ) — (M Im fa , Im (j>j )]- 7 =-• 

j>j +1 V A 1 


Again we can write 
where 

T 3 = - 8 | A 


Z 3 + Y 3 =T 3 + Tg, 


Re</>jlm(e lT v Xi aj ) 

j>AT+l 


Re(e- iT v / ^q- fc ) \ 


, ^ Re Vk a— I 

fc>w+i VAfe / 


+ 8 A 


yy Re (j)j Im( 
j>iv+i 


a, 




/c>iV+l 


and 


n= E 

j>iV+l L 


(M Re <j)j , Re < i>j ) — (M Im cf>j , Im <fij ) 


-4 


(A Re 4>j , Re (j>j ) 


A,- 


Im(q(e 




- 1 )) 


\A7 


We use (6.64) to assert that 


|T'| < 2K ]T 
j>J+i 


A 2 


2A' X 
j>J+i 



Next, from (6.65) we can assert that, for any e, there exists C(e) such that 
ll^llvy < £ ||^||d(A) + C(s)\h\ 
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(see J. L. Lions [1]). Therefore, as easily seen 


|T 3 | <8||2l|| £ ( ff;H //' 


1/2 


E l a /l“+c( e ) E 


1 ^ |2 


E 


la .12 


1 / 2 ' 


3>J +1 

Therefore, collecting results we have 


u’>J+i 


— A, 

u>j+i J 


(r T (h- n J h),h- n J h) 

>11 h- n J h\\f DiA)y ^coT - -E - 4||A||e - ® }. (6.78) 
Therefore for any T > 0, choose 


£ = 


c 0 T 

spir 


and J sufficiently large so that 


c 0 T K + C7(e) 
2 


This concludes (6.77). □ 

Remark 6.4. The idea of the regularizing functions pj has been given to us by 
J. L. Lions [6]. □ 


7 General framework: skew-symmetric operators 

7.1 Operator A 

Let L be a self-adjoint operator in a Hilbert space Hl (which is identified 
with its dual). Let D(L) be the domain of L. We assume that there exists a 
Hilbert space Vl such that 


V L C H L C V' L , 

continuously and densily embedded. 

We assume that 


(Lz 1 ,z 2 ) = ({zi,z 2 )), Vzi ,22 € 14, 

where (( , )) denotes the scalar product in 14. 

We furthermore assume that 


(7.1) 


(7.2) 


the injection of 14 into Hl is compact 


(7.3) 
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In that case L 1 £ C(Hl\Hl) is compact and thus there exists an or- 
thonormal base Wj of Hl, of eigenvectors of L\ i.e., 

Lwj = \ jWj, \wj\n L = 1 , 

with 0 < Ai < A 2 • • • < Xj ■ ■ ■ t 00 . 

Besides D(L) we shall need 

A(L) = {z€V l :Lz€V l } 

and we have the sequence of spaces, each of them being densily and continu¬ 
ously embedded in the next one 

A l c D(L) C V l C H l C Vi C (D{L))' C A' l . 

We can associate with L a skew-symmetric operator A, satisfying the assump¬ 
tions ( 6 . 6 ) to (6.9). Take indeed 

H = H,,xVi A= _° l I q , D(A) =V L x H l . (7.4) 

We have to pay attention to the fact that because H is identified with its 
dual, Vj is in the second component the pivot space, identified with its dual. 
In that framework the dual of Hl is (D(L)) , with the duality 

(z, C) = (^, L~\) Hl , Vz G H L , C G (D(L))'. 

Note that the scalar product in H is expressed as follows: 

(h,h') H = (h l ,ti l ) + {L~ l h 2l ti 2 ). 

Moreover (D(A))' = V[ x (Z)(L)) / . 

The eigenvectors of A are given by 

W Wj 

3 V2 l/v'Aj'''./. ‘ 

7.2 Operator B 


We next define the operator B. We shall consider a control space U = U\ x U 2 
where XJ\, U 2 are Hilbert spaces, identified with their duals. Let q-\. q 2 be 
operators such that 


qi €C{D{L)-,lh), q 2 € C{V L -,U 2 ). 

(7.5) 

We set 


Bv=~\ L ~y ivi 

(7.6) 


and B G C(U;H). Note that 


* ki-'fti 

B h --[q 2 L-'h 2 \- 

(7.7) 


The presence of L 1 in the second component of B* arises from the fact that 
the pivot space is V' L . 
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7.3 Dynamical system 


Consider the dynamic system 

z' = Az + Bv, 2(0) = 0, 

ZGC([0,T]-H), z' G L 2 (0,T; (D(A)Y); 

we deduce 

A = zi ~ L^qlvu 2i(0) = 0, 

A — — Lz\ — q 2 v 2 , ~ 2 ( 0 ) = 0 . 

Hence 2 r G C([0, T]; H L ), z 2 G C([0, T}; V[); z{ G L 2 (0,T;VX), 2 ^ G 
L 2 (0, T; (D(L))'). 

We can associate with (7.9) a second order (in time) equation as follows. 
Set ?? = 22 ; then we also write 

77 " + Lr) = q*v 1 - q 2 v 2 , 

r/(0) =0, j/(0) + g$i*(0) = 0, 

jjGC'QO.T];^), t] 1 +q* 2 v 2 GC([0,T]-(D(L)Y), (7.10) 

? /GL 2 (0,T; (D(L))'), 

7 /" G C([0, T\;A' l ) © i 2 (0, T; (D(L))') © fT^0,T; V L ). 

Note that all terms in (7.10) make perfect sense. However, it is important 
to notice that the value of rf is not defined at each point, and is not 0 in 
any sense in general. It is useful to reinterpret (7.10) in terms of the Method 
of Transposition of J. L. Lions and E. Magenes [1]. Note that for any 
ipo G D(L),ip 1 G Vl, there exists one and only one solution ip such that 


r+Lip = /, 

iP(T)=iPo, iP'{T)=ip li (7.11) 

iPgC{[ 0,T]-D(L)), ip' G C{[0,T];V l ). 

By making appropriate integration by parts between (7.10) and (7.11), we 
deduce the formula 

(ip!,^)) - (ip 0 ,r]'(T) + q 2 v 2 (T)) = f [(«i, qiip) + (v 2 , q 2 ip’)] dt, (7.12) 

Jo 

which can be considered as the definition of r/(T) and rf (T) + q 2 v 2 (T). 

There is a formal but mnemonic way of writing (7.10). Introduce the op¬ 
erator 

Jo G £(tf 1 (0 ,T;£/- 2 );L 2 (0,:r;[/-2)) 

defined by 

Jqu = u!. 
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Its transpose Jg G C(L 2 (0,T; U2); (l? 1 (0,T; C/ 2 )) / ). One should not mix up 
JgU, which belongs to (l? 1 (0, T; U2))' , with —u\ which belongs to jT _ 1 (0,T; U2) 
They coincide only, when applied to Hq (0, T ; U 2 ). Next, consider g 2 as a linear 
bounded operator from U 1 ( 0 ,T; Vl) to I7 1 (0,T; U2), and thus q% as an ele¬ 
ment of £((^(0,^ U2)) 1 ; {H 1 ^ ,T;V l ))'). Therefore Jq G £(L 2 (0,T; t/ 2 ); 
(H 1 ^,T;V l ))'). We write (7.10) as 

v" + L V = Q 1 V 1 + 92 ^ 0 ^ 2 , 77 ( 0 ) = 0 , t? , ( 0 )= 0 . (7.13) 

We know that 

V e C([0,T]-,V[) n L 2 (0,T; h l ), rf eL 2 (o,r ; (d(L))'). 

From (7.13) we read 

rf’ G C([ 0 ,T];Z^) ©L 2 ( 0 ,T; (£>(£))') © (H\0,T-V l ))'. 

The writing is formal as far as ? 7 / (0) (which is not defined) and rf are con¬ 
cerned. What it means is that for any 

0 G H 1 (0, T ; -D(T)) fl L 2 (0, T; Af) 

with ip(T) = 0, then one has 


- (v',i l ')dt+ (rj, Lip) dt= [{vi,qiip) + {v 2 ,q 2 i>')}dt, (7.14) 


where all terms make sense. This equation defines a unique 77 because it implies 
in particular (7.12). The value of rj at any given time t (in particular 0) is 
not the value of the derivative, but a short for rj + q%V2- 


7.4 Exact controllability 

Let us first express the operator I V G C(H;H). By the definition 

(r T h,k)= [ ( B*e AH h,B*e A “ t k)dt. 

Jo 

If we write 



and define <j>, 0 by 


<j>" + Lcf> = 0, %/}" + L'tp = 0, 

0(0) = L _1 /ii, 0(0) = L~ x k 1 , 

0'(O) = -L~ 1 h 2 , 0'(O) = -L~ 1 k 2 , 


(7.15) 


(7.16) 
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we deduce easily from (7.7) that 


B*e AH h = 


Q2<f>'(t) 


(7.17) 


(■ r T h,k)= [ [(qi4>,qitp) + (q 2 (f>',q 2 ip')}dt. (7-18) 

Jo 


Therefore the estimate 

is clearly equivalent to 

rT 


( r T h,k)>c(T-T 0 )\\h\\ 2 {D(A) y 


f (M | 2 + M'| 2 ) dt > c(T - T 0 )(\\m\\v L + l^(O)lk)- 
Jo 


Moreover 

r h _\-L- 1 {ii(T) + q* 2 q2ck l {T)) 

T [ V(T) 

where rj is the solution of (7.10) with 

vi(t) = -qi<j>(t), v 2 (t) = q 2 <t>’{t). 

If we use the formulation (7.13) for the 77 equation, then we may write 


(7.19) 


r T h = 


-L~W(T) 

V(T) 


(7.20) 


but if (T) is not the value of rj at T, which is not meaningful because rj is 
only an L? function, but a mnemonic to denote an element of ( D(L )defined 
by the relation 

— f ( V ',Tp')dt+ f (ry, Lip) dt 
Jo Jo 

= [ [(vi,qiif>) + (n 2 ,g 2 '0 / )] dt (7.21) 
Jo 

for any G H 1 (0, T; D{Lj) D T 2 (0, T; A L ). 

Let us now try to check how we can satisfy the sufficient assumptions of 
exact controllability as stated in Theorem 6.1 and find the operators M, A 
satisfying (6.14) and (6.19). We shall suppose that there exist operators 7Ti, 
7 T2 and a form &(£,£') such that 

7 ri € £(£>(£);£>(£)'), 7 t 2 € C(V L ; V[), 

b is bilinear continuous on Hl x Vl, 

WiC\ 2 > (TTrC.C), VCGD(T), 

|52C| 2 >(M,C), VC G V L , 


(7.22) 
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(7Ti Wj,Wk) = Xjb(wj,Wk) + A k b(w k ,Wj), Vj ^ k > N + 1, 
b(wj,w k ) + Wj) + (Tr 2 Wj,w k ) = 0, Vj^k>N+ 1, 


— (7Ti Wj,Wj) + (TT 2 Wj,Wj) > 2co, Vj > IV + 1, 
Aj 


(ttiWj, Wj) (7 T 2 Wj,Wj) _ ^b(wj,Wj) 


A] 


A 


1/2 


A 


1/2 


< 2 A, Vj > N + 1. 


We then define 


(7.23) 

(7.24) 

(7.25) 

(7.26) 


(M£,ri) = (mL ,L 1 rn) + (TT 2 L ,L 1 r] 2 ), V^ryGi/, (7.27) 
( 2 ^, 77 ) =6(^i, 7 ti), V?ei7, V £D{A). (7.28) 

It is easy to check that all assumptions (6.14)-(6.19) are satisfied. 

As a consequence of Theorem 6.1 we can state the following theorem. 

Theorem 7.1. Consider the pair (A, B) defined in §7.1 and §7.2. Assume 
(7.22) to (7.26) and (6.20). Then the pair (A, B) is exactly controllable for T 
sufficiently large. 

Let us check what must be added to obtain exact controllability at any 
T > 0. We replace (7.26) by 


(TTlWpWj) 

A/ 


{-K 2 Wj,Wj) -4i>{wj,Wj) 


< 2 K, 


Vj > N + 1. 


We also assume that there exists a Hilbert space Wl such that 


Vl C Wl C Hl, the injection of V L in Wl is compact 
b is bilinear continuous on Hl xWl- 


(7.29) 


(7.30) 


Then (7.29) implies (6.64) and (7.30) implies (6.65). 

We can then state the following theorem. 

Theorem 7.2. We make the assumptions of Theorem 7.1, except (7.26), 
which is replaced by (7.29), and we assume (7.30); then the pair (A, B) is 
exactly controllable for any T > 0. 


8 Exact controllability of hyperbolic equations 

We shall apply in this section the results of §6 and §7 to the exact con¬ 
trollability of the wave equation, Maxwell equations, and the plate equation 
with boundary control. The domain Q considered in the sequel is smooth and 
bounded. 
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8.1 Wave equation with Dirichlet boundary control 

We take L = —A, with 

H l = i 2 (0), Vl = Hl(n), 
d{l) = H 2 {n)nH^{n), 

A l = {zG D(L): Az G f#(ft)}. 

We take U\ = U 2 = L 2 (r) and qi = d/dv, q 2 = 0. Let 

m(x) = x — xq, R{x 0 ) = sup \m(x)\. 

igr 


We define 

* 2 = °’ <8,1) 

biz ’ 0= -Rk)i^ m ^-S: dx - (8 - 2) 

Consider the eigenvectors Wj defined by 

—Awj = A jWj, Wj\ r = 0; (8-3) 

then we have the relation 


m ■ v- 


duij dwk 
dv dv 


dr 


(2 tt) \J A jXt Sj / ;: J* 'y ' r/r Y> : ^ 


, dw k 

x ’ w ’dZ 


dwj 

A kWk-z — 

OX n 


dx (8.4) 


for any j, k. Then taking N = 0, all assumptions of Theorem 7.1 are satisfied. 
The system to be controlled is, according to (7.12) 

~ (ipo,ri'(T)) = j {vi,^jdt, (8.5) 

where if) satisfies 

( " -Aip = 0, 

|^| r = 0, (8.6) 
Ucn = V>o, ^'(T) = ipi, ipiGHl 

The relation ( 8 . 6 ) is the “Method of Transposition” definition of 


f 77 " - Ai 7 = 0, 
[ 77 ( 0 )= t/(0) = 0. 


(8.7) 
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The exact controllability property is expressed as follows: Given y 0 G L 2 , 
y-\ G H~ x , for T sufficiently large, the system 

! rj" — Ay = 0 , <j>" — A(j) = 0 , 

= <t>r = 0, ( 8 - 8 ) 

v(0) = v'{0) = 0, rj(T) = yo, rf(T)= yi 

has a solution with ^(0) G H q, and <j>'( 0) G L 2 . 


8.2 Wave equation with Neumann boundary control 

We take now 


L = —A + I, H l = L 2 {Q), V L = H\n), 

D(L) = [zeH 2 (n):^- = oj, 

= J = o|. 

The eigenvectors are defined by 

r - Awj+wj = Xj Wj, 

1 ® W j n (8-9) 

Note that Ai = 1 and w\ = l/|f2|. 

The eigenspace corresponding to Ai is one dimensional. We next take U\ = 
(L 2 (Ti))” +1 , U 2 = L 2 (r 0 ) (see (5.21) for the definition of r 0 and A), and 


qiz 


liz 
7 i Dz 


for z G D(L), 


q 2 z = 702 , for z G H 1 . 


Note that for 

\/z G D(L), 71 Dz = D a) xl\z. 

See §5.3 for the notation. Define then 


( 7 r iC) CO = -R^J r m ■ KCC' + DC ■ DC) dr, VC, C' e D(L), 


( 8 . 10 ) 


( 8 . 11 ) 

( 8 . 12 ) 


Similarly define 
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We use the following relation among eigenvalues: 


J m ■ v(wjWk + DwjDwk ) dr = (n— 2)\JXjXkdjk + 2djk 


E 


"M XjW ifc 


dwk , du)j , , 

A kWk-g^- ) dx. (8.14) 


Pick N = 1. Consider j 7 ^ k > 2. It is easily checked that the properties (7.22) 
to (7.26) are satisfied. Let us check (6.20). It follows from the fact that 


\B*(j)i\ 2 = 


in 

2|fi|' 


Therefore all assumptions of Theorem 7.1 are satisfied. 
The system to be controlled is, according to (7.12), 


(Vh ,V(T)) - {ip 0 ,v'(T) + q2V 2 {T)} 

= f f ( v ioi> + E^TT") dr + [ [ V 2 tp'dr, (8.15) 
Jo Jr 1 ax i Jo Jr n 


where 


and ip is the solution of 


Vl 


V 10 

V 12 


Vl n 


(ip" - Aip + i> = f, 

f = 0 , (8.16) 

[ 1 p(T)=ip l (T) = 0. 


We can consider Vi as an element of (i7 1 (T 1 ))^ by the following duality for¬ 
mula (see also (5.29)): 


( vi,6) = f ( wio7i^ + E 

J r V i= 1 


99 \ rlT 

v " 1 'aT, dr ' 


Consider the special case 


dx d\ 

fio = 71 X 1 vn = with — = 0. 


(8.17) 


(8.18) 


Then 
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dx dO 
' 7 l fe~ 7 l fe“ 


(vi,0} = Jr |7iX7i6' + ^ 

= J ^7iX7i0 + CT *,171X0"*,i7i^| dr 

= {7iX“ Ari7iX}7i 0dr , 

Jr i 


(8.19) 


where 


“Ari = ^2 a *,i 


represents the tangential Laplacian on /), which is an element of 

mrx))'). 

So we can write (8.15) as 


77 " — Ay + 77 = 0 , 


$77 
<9 7 / 


A, 


« dy 

~ J 0 V 2 , ^ 


= th, 


A 


( 8 . 20 ) 


7 7 (0) = t? , (0)=0, 


with the interpretation of the operator Jo already discussed in §7.3. 

Let us express the property of exact controllability. Let yo £ L 2 , y 1 £ 
(ff 1 )!!)) ; then for T sufficiently large, the system 


77 " — Ai 7 + ?7 = 0, 

dy I 


dv 


= -Jo^, 


A 


d(j> 

dv 


>” -A<j> + <j> = 0, 


= 0 , 


dv 


A 


y(T)=yo, y'{T)=y 1 , 
r7(0) = 0, 7/(0) = 0 


At 1 <£ - </, 


( 8 . 21 ) 


has a solution with 0(0) £ H 1 , <j>'(0) £ L 2 . We recall that J^cj)’ belongs to 
(F 1 (0,T;L 2 (r 0 )) / ) and -A al <j> + cj> to L 2 (0,T; (^(A))'). 


8.3 Maxwell equations 

Let us introduce some notations. Let L 2 (fl) = (L 2 (fl)) 3 , L 2 (r) = (^L 2 (r)^j 3 

and similarly, H fc (fl) = (jf fc (fl)) 3 . If v £ H 1 )!!), we set curl v = D x v, where 
x symbolizes the external product. We recall the relations 

curl gradu = 0 , div curlt; = 0 . 

Furthermore, the set O being assumed smooth and singly connected, we have 
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Define 

J = closure in L 2 (D) of functions belonging to 
(C 00 (fi)) 3 with divergence 0, 

K = closure in L 2 (fl) of functions belonging to 
(C“(D)) 3 with divergence 0, 

Ji={uGH 1 (D): divv = 0, v x v = 0}, 

K\ ={u £ H 1 (D): divu = 0,u • v = 0}, 

where v represents the external unit normal. We provide J\ and K\ with the 
scalar product 

((u,u)) = (curl u, curl v) (8.22) 

for which they become Hilbert spaces. Indeed if v £ J\, curl v = 0, then 

v = curl X-, curl curl \ = 0. 

Using the integration by parts formula 

(curl 0, -0) = {(j), curl ip) + J <f> x v ■ ip dr, (8.23) 

we deduce easily that curl % = 0; hence v = 0. Similarly if v £ K\, curl v = 0, 
then v = Dp and Ap = 0, with dp/dv = 0; hence p is a constant, which 
implies again v = 0. It can be proved (see (8)) that 

Ji C J, K\ C K (8.24) 

with continuous and dense embedding. Moreover curl is an isometry from J\ 
to K, and K\ to J. The norm thus defined on J\ and K\ is equivalent to that 
induced by H 1 (H). We shall further need the spaces 

J 2 = {v G H 2 (H): divu = 0, v x u = 0, v ■ curl v = 0} , 
divu = 0, v x v = 0, 
v ■ curl v = 0, v x curl curl v = 0 

and 

K 2 = {« £ H 2 (H): divu = 0, v ■ v = 0, ^xcurlv = 0} 

divu = 0, v ■ v = 0, 1 (8.26) 

v x curl v = 0, v • curl curl v = 0 J 

The spaces J 2 and K 2 are provided with the norms 





(Ml = |curl curl v\ 
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and J3, A3 with the norms 


11 v | = | curl curl curl v \. 

Then curl is an isometry from J2 to K\. J 3 to K 2 , K 2 to Ji, and A3 to J2. 
Note that from (8.23) we have 

(curl (j>, ip) = (curl?/), </>) (8.27) 

with (j) G Ji, ip G Ki, or (j> G K\, ^ G J\. It follows that curl can be extended 
as an isometry from J to (ATi)' and AT to {J\)'■ Similarly it extends as an 
isometry from (A'i)' to {J 2 )', (Ji)' to (A" 2 )', (J 2 )' to (K 3 )', and (A' 2 )' to 

(JsY- 

Summarizing we have the sequences 

j 3 c j 2 c Ji c j c (a/ c {j 2 y c (j 3 y, 

k 3 c at 2 c k r c k c {K x y c (at 2 )' c {K 3 yt 

with each space being continuously and densely embedded into the next one. 
Moreover curl curl is an isometry from J 3 to Ji, J 2 to J , Ji to (Ji)', J to 
(J 2 ) 7 , and (Ji)' to (J 3 )', and a similar result with J changed into AT. 

Define 

H l = K, V L = A'i, A>(A) = A' 2 , A(L) =K 3 , L = curl curl. (8.29) 

The eigenvectors Wj are given by the relations 

{ curl curl Wj = XjWj, diviu,- = 0, 
v ■ Wj =0, v x curl vjj = 0 on A, (8.30) 

KI = !• 

We shall use the following relations among eigenvectors: 


J m ■ v curl Wj ■ curl Wk dr = (n — 2) y 7 A j Xk 5jk 

dw k 


E 


XjWj 


dx a 


dvo ■ 

+ Afcui fc • ) dx (8.31) 


with again m{x) = x — x 3 . 
Define next 


We can take 


[7 2 = L 2 (Ao), A 1 = {uGL 2 (r 1 ): .x» = 0), 
qi = -71 curl, q 2 = -70. 
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teC, CO = - / m • v curl C • curl C dr, vc, C e k 2 , 

teC,CO = J m-v{- c dr, VC, C' e /Vi, 

biz '° = --sk)I a '£ m - z '§: dx ’ Vz e < eKi ' 


(8.32) 

(8.33) 

(8.34) 


Then all assumptions of Theorem 7.1 are satisfied, with N = 0. 

We next interpret the system to be controlled. Consider (7.11) and (7.12); 
we get for ip 0 € K 2 , ipi € Kj 


ip" + curl curl ip = 0 , 
div ip = 0 , 

v ■ ip = 0 , v x curl ip = 0 on T, 
ip(T)=ip 0 , ip'(T) = ipi, 


(8.35) 


(ipi,r](T)) - (ip 0 ,r]'(T) + q 2 v 2 {T)) 

/ v 1 • 71 curl ip dr + / v 2 ■ ^io'ip' dr dt. (8.36) 

Ji 1 Jr 0 

Now, we use the formula (see (5.22)) 

7 curl ip = v x + D a x 7 ip on T (8.37) 

av 

and similar relations on To and J\. Using the fact that v\ belongs to U\, we 
have 



/ V! • 71 curl ip dr = -(D* al x wi, 7 i^>), 

J A 

[ v 2 ■ 70 ^' dr = (JqV 2 , 70 ^) • 

Jr 0 

We then can write (8.36) as follows (using the Method of Transposition): 


77 " + curl curl 77 = 0 , 
div ?7 = 0 , 

77(0) = 77'(0) = 0 , 

7 / x curl 771 = £>*! x vi, 

v x curl 77 | r = -JqU 2 . 


(8.38) 


We see that 1 / x 77 ]^ belongs to L 2 (0, T; i7 1 (A)0 and ^ x »?| r belongs to 

(i7 1 (0, T; L 2 (/o)) , . Let us then express the condition of exact controllability. 
Given j/q in K and y 1 in (K i) 7 , we consider the system 
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' rf' + curl curl 7 / = 0, 
divr/ = 0, 

< t?(0)=r ? , (0)=0, 

v x curl 77 ]^ = D* al x 71 curl0, 
, v x curl v\p 0 = Jofi > 


<j>" + curl curl <p = 0, 
div (f> = 0, 

< r]{T) = y 0 , rf{T)=y u (8.39) 
<p ■ v = 0, 
v x curl 0 = 0, 


which has a solution with 0(0) £ K\ and 0'(O) £ K, at least for T sufficiently 
large. Furthermore we know that 77 € C([0,T]; K[) and 7 / € L 2 ([0, T]\K' 2 )- 
Reducing (8.39) to Maxwell equations by setting 

H = curl 77 , E = — rf, ip = — curP 1 <p', 


we deduce the relations 
' E' = curl 77, 

H' + curl I? = 0, 
div FI = di vH = 0, 

’ 77 x H\ n =D* al x 7l 0', 
^ x h\ Fo = J* 0 4 >', 

. E{ 0) = H( 0) =0, 

with 


r <p' + curl0 = 0, 

ip' = curl0, 

< div (p = div ip = 0, 

E(T) = E t , H(T) = H t , 
cp ■ v = 0, v x ip = 0, 


(8.40) 


fleC([0,T];J'), 
H 1 £L 2 ([0,T]-J' 3 ), 
€ C([0, T]; Ad), 
cp' e C{[0,T]-K), 


E£L 2 ([0,T]-K' 2 ), 
E'£L 2 ([0,T];K' 3 ), 
V’ € C([0, T); Ji), 
iP'eC([0,T];J). 


The values Et and Ht are any elements of K[ and J(, respectively. The 
system (8.40) has a solution for T sufficiently large. 

We now turn to another situation where we shall be able to use The¬ 
orem 6.2 instead of Theorem 6.1 (which permitted to state Theorem 7.1). 
However we assume the geometric condition 


to • v > 0. (8-41) 

Consider again (8.29). Take U\ = U 2 = L 2 (C) and qi = — 7 , (72 = 0. We 
define A, B as in §7.1 and §7.2. We note that B £ B(A) and thus (6.31) is 
satisfied. We then take 

(M£, 77) = y J to • vL- 1 ^ 1 • L _1 77i dr, ( 8 . 42 ) 

= (8 ' 43) 

(Q^rj) = —- - [ m • v curl L -1 £i • curl L~ x r)\ dr. (8.44) 
R{%0) Jr 
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Let us check the assumptions of Theorem 6.2, with N = 0. Thanks to 
(8.41) the assumption (6.14) is satisfied and (6.15) is trivial. The property 
(6.33) is clear from the definition of <f>j and that of M, A. From the definition 
of Q and the relation (8.31) the property (6.34) is easily checked. It remains 
to check (6.35) and (6.36). But 


(MRe<j>j, Re<f)j) = 


2R(xo)Xj j r 


2 i m-v\wj\ z dr , 


( Q Re (pj , Re <pj ) = 
and from (8.31) 




m-v | curl Wj | 2 dr 


(MRe<j>j,Re(j>j) — -^-( QRe<f>j,Re</)j ) = 


R(x o)A2 ! 


therefore (6.35) is satisfied with 


co 


Now 


1 

R{x 0 )' 


(MRecj)j,Re4>j) + 


-^-(QRe4>j,Re(l)j) 
A i 


1 

R(x 0 )X 2 j 



m ■ v\vjj\ 2 dr 


and 



v\wj\ 2 dr 



diVj , 

m a Wi ■ ——— dx + n 
ox a 


41? (xq ) {A Re (j>j , Re <j>j) + n, 


and in particular the property (6.36) follows. The dynamic system is given by 


rf + curl curl r/ = 0 , 
divry = 0 , 

?? ( 0 ) = 7/(0) = 0 , 
v x curl?;| = —v. 

We express the property of exact controllability as follows. 

The system 

{ rf + curl curl t] = 0, (</)" + curl curl <j> = 0 , 

div ?; = 0 , I div <j> = 0, 

?;(0) = rf{ 0) = 0, j n(T) = y 0 , rf(T) = y u 
v x curl?;| r = 7 (j), \(j> - v = 0 , v x curl </ = 0 


(8.45) 


(8.46) 
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has a solution for T sufficiently large, with y 0 G K\, yi G K. Moreover 
0(0) G K, 0'(O) G (Ki)'. We have V G C([0,T]-,K), V ' G C7([0, T]; (A0)'). 
Reducing to Maxwell equations as above we obtain the system 


' E' = curl H , 

E' + curl E = 0, 

< divE = di v H = 0, 
v x H\ r = 70, 

. E(0) = E(0) = 0, 


r 0' + curl0 = 0, 
ip' = curl 0 , 

< div 0 = div 0 = 0, 

E(T) = E t , H(T) = jy T , 
cp ■ v = 0 , u x %p = 0 . 


(8.47) 


For any given Ep and Ep in K and J, respectively, and for sufficiently large 
T, the system (8.47) has a solution such that 


H G C([0, T]; J(), 

fl'GC([0,T];4 

0GC([O,T];E), 

0' GC([0,T];(E 1 ) / ) 


EgC([0,T];E(), 
E'gC([0,T];E'), 
0G<7([O,T];J), 
ip' G C([0,T]; (Ji)'), 


and 70 belongs to E 2 (0,T; L 2 (E)). 


8.4 Plate equation 

We begin with Neumann control. We take Hl = E 2 (fl), Vl = Eq (Cl), D(L) = 
E 4 (fl) n and 

E = z4 2 , Z\(E) ={zG E 2 (ft): Zl 2 2 G E 2 (f7)}. 

The eigenvalues related to L are defined by 


' A 2 Wj = A jWj , 


Wj\r = 


dw 3 

dv 


= 0 , \wj\ = 1 . 


(8.48) 


Considering again the multiplier m(x) = x — xq, we can check the relation 


/ to • uAwj Awk dr 

" r f f du) c)u) \ 

= {4-n)y/\j\k6jk - J T, TOq A; ' r ./~T~ + ris. (8.49) 

We take Ui = U 2 = E 2 (E 0 ), where we recall that E 0 is the part of the boundary 
on which m ■ u > 0. We pick qi = —^qA and <72 = 0. 

It is useful to introduce the space E 3 (Q) n Eq (f2), intermediary between 
Vl and E(E), equipped with the norm || 2 || = \D(Az)\. Note that L is an 
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isomorphism between H 3 fl Hq and H~ l . We shall check the property of 
approximate controllability for any T > 0, by checking the assumptions of 
Theorem 7.2. We take N = 0. and we define 


(ttiC) CO = j rn ■ vAQAC,' dr, tt 2 = 0, 

b(zX) = -nk) 

The properties (7.22), (7.23), and (7.24) are easily verified. As 

= 7^5 “ d = 277 wr 


(8.50) 

(8.51) 


(8.52) 


the properties (7.25) and (7.29) are clear. It remains to check (7.30). We define 
Wl = Hq and the assumption (7.30) is satisfied. Therefore, all the assump¬ 
tions of Theorem 7.2 are now satisfied. Thus the pair (A, B ) is approximately 
controllable for arbitrary positive T. Let us interpret this result. The dynam¬ 
ical system is described by 


(ip!,r](T)) - (ip 0 ,r]'(T) + qlv 2 {T)) = - f f vAipdxdt (8.53) 

J o J r 0 

for ip 0 G H 4 n Hq and ipi G Hq and ip being the solution of 


>" + Z\V = /, 
m = ip'{T) = o, 

*lr = £| r = 0 ’ 

> G C([0, T]; H 4 fl Hq), iP' G C7([0, T]; H 2 ). 


(8.54) 


We interpret (8.53) as follows: 


f rf + Z\ 2 ?? = 0, 

77(0)= 7/(0) = 0, 

< 'dir = °> = 0 ’ 


jr 
9?7 
dv 


A 


= v, 


r 0 


U G C([0, T}; V[), i G C([0,T]; (D{L))'). 


(8.55) 


Let us express the controllability property. Given y 0 G L 2 (fi), y\ G H 2 (fl), 
the system 
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[ rj" + A 2 y = 0, ft' + A 2 (/> = 0, 

d(p 
dv 


? 7 ( 0 ) = v'(0) = 0 , 4>\ r = 


V 


= 0 

r ’ dv 


= o, 


= 0 r)(T) = 2 / 0 , rf(T) = y u 


A 


A’ 


_ Al\ 

dv ^ 

<j>£C([0,T];H 2 ), <j/ £ C([0, T\; L 2 ), 

{At\ ro eL 2 (o,T- : L 2 (r 0 )) 

has a solution for any T > 0. 

We next consider a more elaborate case, where we control y and Ay on 
the boundary. We need some notation. Let J n be such that 

Jn = {z€ H n : z\ r = 0, Az\ r = 0,..., A n ~^ 2 z\ r = 0}. 

Hence J\ = H g, J 2 = H 2 D Hq _We provide J n with the norm 


f \A n t 2 z\ 2 , if n is even, 
lZlljn _ I \DA n ' 2 z\ 2 , if n is odd. 


We set Jo = L 2 ( f2). The operator —A is an isometry from J n to J n _ 2 , n > 2. 

Denote J n the dual of J„, when Jo is the pivot space. Clearly — A extends 
as an isometry between J„ and J_„_ 2 , and we have the sequence 


Jn C Jn— 1 C J n —2 A * * * Cl J1 Cl Jo A J—1 * * * A J—r 


In the above sequence, suppose that we pick J\ to be the pivot space, identified 
with its dual. Then the dual of J 2 is Jo, the dual of J 3 is J_i, and the dual 
of Jn IS J— n _|_ 2 . 

The duality pairing is in the first case ( Jq pivot) 


((-A) n / 2 u, (-A)~ n / 2 v ), if n is even, 

(£>(— A) n ~ 1 / 2 u, D(—A)~ n+1 / 2 v), if n is odd 


with u £ J n , v £ J- n - 

Now in the case when Ji is chosen as the pivot space, then the duality 
pairing is given by 


((—Z\)"/ 2 m, (— A) n ! 2 1 v), if n is even, 

(D(— Z\)" - 1 / 2 it, D{—A)~ n ~ 1 J 2 v), if n is odd 


(8.57) 


with U £ J n , V £ J-n+2- 

We choose in the sequel Ji to be the pivot space. Let Hj j = Jy. Vj J = J 3 , 
D{L) = J 5 , and A(L) = J 7 . Then V[ = J_i, (D{L))' = J_ 3 . 
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We pick L = A 2 . The eigenvectors are defined by 


A Wj — XjWj, 


y?l r = Aw ir = 0 ’ IKII = 1 » 


(8.58) 


and the Wj form an orthonormal system in J\ the pivot space. We shall use 
the relations 

f d d 

/ to ■ v—Awj —- Awkdr 
Jr ov ov 

f ( duo dvo \ 

= (2 +n)^/\j\ k 5jk - J £ m a (\jAw k -£- + A^t^J dx, (8.59) 


m ■ vl r—Awj ) dr + A,- / m-v ( —to,- I dr = 4A,-. 


(8.60) 


We take U\ = U 2 = L 2 (r 0 ). We recall that 


n o = a - 
Ov 

on r 0 . We define <71 = no A, q 2 = no- We then take 


{,,lC ’ C) = nhI r m "'^ A< ^ ACdr ’ 

( ’ r2< ' < ' , = 7 

bM =-RhLr’ m ° A( £t dx - 


(8.61) 

(8.62) 


(8.63) 


Let us check that the assumptions of Theorem 7.2 are satisfied, with N = 0. 
The properties (7.22) and (7.23) are clearly satisfied. The relation (7.24) can 
also be checked, taking into account the fact that the Wj are orthogonal in 
Hq. Let us check (7.25). We have 

T-^l W r W i) + (7T 2Wj,Wj ) 


1 f 1 


— / to • v —— Awj\ dr + / to • v —— Wj\ dr\ = 


R(xo) LAi Jr \dv J \ Jr \dv J \ \ 
from (8.60). Hence (7.25) is verified. Let us check (7.29). We have 


R(x 0 ) 


b(wj,Wj) = - 


( 7 T 2 w jl w j ) 2-: 


2R(x 0 ) ’ 


hence 
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— (7Ti Wj,Wj) - (7T 2Wj,Wj) - Ab(Wj,Wj) = -^-y 

and (7.29) is satisfied. Let us finally check (7.30). We take Wl = J 2 and note 
that 

1^.01 

As the injection of J 3 into J 2 is compact the assumption (7.30) is also satisfied. 
Therefore the assumptions of Theorem 7.2 are now satisfied. Thus the pair 
(A, B) is exactly controllable for arbitrary positive T. 

The dynamic system is given by the relation 


{ipi,v(T))-{ipo,v'(T) + qZv 2 (T))= J j (v^Aip + v 2 ^i>' 


where ipo G J 5 , ipi € J 3 , and ip is the solution of 


dr dt, 
(8.64) 


>" + A 2 ip = 0, 
ip(T)=ip 0 , ip'(T)=ip 1 , 
ip\ r = Aip\ r = A 2 ip\ r = 0 , 

>GC([0 ,T];J 5 ), ip' g C([o,r] ; J 3 ). 


(8.65) 


Writing £ = — Arj, we interpret (8.64) as follows: 

'C" + A 2 C = 0, 

C(0) = C'(o) = 0 , 

< C| A = 0, AC\ n = 0, (8.66) 

C| ro =^i, A C\r 0 = J o v 2, 

.C e i 2 (0, T; J_r) n C([0, T]; J_ 3 ), C' £ £ 2 ([0, T] ; J_ 5 ). 

Let us express the controllability property. Given yo in J\ and y\ in J_ 3 , the 
system 


+ A 2 ( = 0, <f>" + A 2 (f> = 0, 

C(0) = C'(0) = 0, 4>\ r = A(p\ r = 0, 


C\ n = 0 , A(\ n = 0 , C(T)=yo, 


C G L 2 (0, T; J_r) n C([0, T]; J_ 3 ), 0 G <7([0,T]; J 3 ), 

,C'GL 2 ([0,T];J- 5 ), <j>' G C([0,T]; Jr) 


(8.67) 


has a solution for T > 0 arbitrary. 

Remark 8.1. For other examples and results of exact controllability see J. L. Li¬ 
ons [1, 5] where the HUM method is presented in full generality, I. Lasiecka 
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and R. Triggiani [9, 10, 11, 13], R. Triggiani [4], J. E. Lagnese [1], 
and J. E. Lagnese and J. L. Lions [1]. The Maxwell equation is treated in 
J. E. Lagnese [2], The result of exact controllability for the plate equation 
is given in E. Zuazua [1] and I. Lasiecka and R. Triggiani [13]. For the 
use of microlocal analysis in the context of exact controllability, we refer to 
C. Bardos, G. Lebeau, and J. Rauch [1] □ 



Part IV 


Quadratic Optimal Control: Finite Time 

Horizon 





Bounded Control Operators: Control Inside 
the Domain 


1 Introduction and setting of the problem 

In this chapter we consider the dynamical system governed by the equation 

f x'(t) = Ax(t .) + Bu(t), t > 0, 

|a:(0) = x 0 G H , 

where A: D(A) C H —> H, B: U — > H are linear operators defined on the 
Hilbert spaces H (state space) and U (control space), respectively, x is the 
state and u the control of the system. We shall also consider another Hilbert 
space Y, the space of observations. The inner product and norm in H, U, and 
Y will be denoted by (-, •) and | • j. Whenever confusion is possible a subscript 
H, U or Y will be added. 

Given T > 0, we want to minimize the cost function 

J(u) = [ T {\Cx(s)\ 2 + \u(s)\ 2 } ds + (P 0 x(T),x(T)) (1.2) 

Jo 

over all controls u G L 2 (0, T; U) subject to the differential equation constraint 
(1.1). Concerning the operators A, B, C, and Pq we shall assume that 

{ (i) A generates a strongly continuous semigroup e tA on H, 

(ii) B G C(U; H), 

(iii) Pq G C{H) is hermitian and non-negative, 

(iv) C G C(H; Y). 

We shall also say that {A, B,C, Pq) verifies assumptions (H). Assumption 
(7Y)-(iv) means that the observation operator is bounded. However in §4 be¬ 
low we shall also consider the more general situation when C is unbounded. 
Under assumptions (7Y)-(i)-(ii), problem (1.1) has a unique mild solution 
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x £ C([0,T\;H) for any xo G H and any u G L 2 (0,T-,U) (see Part II, Chap¬ 
ter 1, §3.1). Moreover x is given by the expression 

x(t) = e tA x o + f e^ t ~ s ' >A Bu(s) ds. 

Jo 

A function u * G L 2 (0,T;U) is called an optimal control if 
J{u*) < J(u), Vu € L 2 ( 0 ,T; U). 

In this case the corresponding solution of (1.1) is called an optimal state 
and the pair (u*,x*) an optimal pair. Under hypotheses (TL) it is easy to see 
that there exists a unique optimal control (because the quadratic form J(u) 
is coercive on L 2 (0,T;t/)). However we are interested in showing that the 
optimal control can be obtained as a feedback control (synthesis problem). For 
this purpose we shall describe the Dynamic Programming approach, which 
consists, essentially, in the following two steps: 

Step 1. 

We solve the Riccati equation 

jp> = A*P + PA - PBB*P + C*C, 

\P(0) = P o . 


Step 2. 

We prove that the optimal control u* is related to the optimal state x * by the 
feedback formula 


u*(t) = —B*P(T — t)x*(t), t G [0,T], 

and moreover that x* is the solution of the closed loop equation 

(x'(t) = [A — BB*P(T — t)\x(t), t£ [0,T], 

\ ic(0) = x 0 . 


2 Solution of the Riccati equation 

2.1 Notation and preliminaries 

We first introduce some notation. Let H be a complex Hilbert space; define 

S(H) = {T G C(H): T is hermitian}, 

S + (H) = {T £ E(H): (Tx, x) > 0, Va; G H}. 
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The space F(H), endowed with the norm of C(H), is a real Banach space 
and E + (H) is a cone in F(H). For any interval I in R, we shall denote by 
C(/; S(H)) the set of all continuous mappings from I to S(H). We next 
consider the set of all strongly continuous mappings F: I —> F(H) (that 
is, such that F(-)x is continuous for any x € H). We shall mainly use the 
following concept of convergence, called strong convergence. A sequence { F n } 
is strongly convergent to F if 

\/x € Ft, lim F n (-)x = F(-)x in C(I;F[), 

n—»■ oo 

where C(I; H ) is endowed with the topology of uniform convergence on com¬ 
pact subsets of I. This topological space will be denoted by C s (l-, S(H)). If / 
is compact we can also consider a stronger topology. Indeed, if F is strongly 
continuous, the number 

11*11= sup \\F(t)\\ (2.1) 

tei 

is finite by virtue of the Uniform Boundedness Theorem. The space of all 
strongly continuous mappings F: I —> S(H), endowed with the norm (2.1), 
is a Banach space and will be referred to as C„(/; U(I7)), where the subscript 
u stands for uniform convergence. Note that the spaces C u (l; E(F[)) and 
C s (/; F(H)) are equal as sets, but their topologies are different. In particular 
C(I-,E(H)) is a proper closed subspace of C u (l\ £(H)) , but it is a dense 
subspace of C s (/; S(H )) if H is separable. (The fact that Ft is separable will 
not be used in the sequel.) If F € C s (l; S(H)), then it is easy to check that 
||F(-)|| is Lebesgue measurable (see N. Dunford and R. S. Schwartz [1], 
Lemma 3, p. 616). 

Remark 2.1. The above terminology is both natural and convenient, but it 
may deserve some extra general comments. Given a compact interval / in R, 
there are two underlying spaces C(l;C(H )) and £(H; C(/; H)) and the space 
C(H; C(F, H)) has two different topologies. The notation C u (l-,£(H)) applies 
to the space C(H; C(F, H)) endowed with its natural Banach space topology; 
C s (l; £(H)) denotes the same space endowed with the weaker non-Banach 
topology T s of pointwise convergence : 

a n —> a <t=> Vcc £ FL, a n (x) —> a(x) in C(I; F[). 

The space C(H-,C(F, H)) coincides with the space of all strongly continuous 
mappings A: I —> C(F[). The mapping A induces a map a: F[ —> C{I]H) 
defined by a(x)(t) = A{t)x and because 

\/x € H, sup \A(t)x\ < oo, 
tei 

we conclude from the Uniform Boundedness Theorem that 

sup II A(t) || C(H) < 00 . 
tei 
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By interchanging the order of the sup’s 

sup sup|A(t)x| = sup sup |H(t)x| = sup ||-A(t)||,c(if), 

|i|=i tei tei |*]=i tei 

we conclude that a belongs to C(H; C(I; H)). Using this construction the 
space C(l; C(H)) of all uniformly continuous mappings can be identified 
with a closed but smaller subspace of £(P; C(I; if)) because the norm on 
H)) coincides with the norm on C(l\ C(H)) by interchanging the 
sup’s. In particular C(H; C{I]H )) contains all strongly continuous semigroups 
of class Co, whereas C(/; C(H)) only contains uniformly continuous semi¬ 
groups. The reader can easily check that the space £(P; C{I\ H )), endowed 
with the weaker topology T s , remains closed, but the space C(l\C{H )) is now 
dense when H is separable. □ 

We define Cj (/; H{H)) as the set of all mappings F £ C S (J; S(H)), which 
are strongly differentiable (that is, such that F(-)x is differentiable for any 
x £ H) and such that their derivative belongs to C s (l;H(H)). We set 

Cl(F,S+(H)) = {F £ C\ (/; 2(H )): F(t) £ S+(H),Vt £ /}. 

Finally we denote by C“(/; E(H)) the set of all Holder continuous mappings 
from / to F(H) with exponent a £ ]0,1[. 

We are given a linear operator A that is the infinitesimal generator of a 
strongly continuous semigroup e tA in H. By the Hille-Yosida theorem, there 
exist M > 1 and wfl such that 

\\e tA \\<Me ut and ||e M "|| < Me"*, t > 0, ( 2 . 2 ) 

where the A n ’ s are the Yosida approximations of A. For any T > 0 we set 

M t = sup{||e tj4n ||: t £ [ 0 ,T],n€N}. 

Finally we denote by A* the adjoint operator of A. 

In the sequel, we shall need a generalization of the Contraction Map¬ 
ping Principle. Let T > 0, and let {yv,} be a sequence of mappings from 
C„([0,T]; S(H)) into itself such that 

||7n(P)-7n(Q)||<a||P-Q||, 

for all P,Q£ C„([0, T]; S(H)) and all n £ N, where a £ [0,1[. 

Moreover assume that there exists a mapping 7 from the space C u ([0,T]; 
Y(P)) into itself such that 

lim 7 -(P)= 7 m (P) inC s ([0,T];U(P)), (2.3) 

n—>oo 

for all P G Cu([0,T]; E(H)) and all m G N, where 7 m and 7 ^ are defined by 
recurrence as 
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7 1 = 7, 7 m+1 0P)=7(7 m 0P)), 

7^ = 7n, 7r +1 (^)=7n(7r( J P))> 
for to = 2,3,, and P e C s ([0, T]; £(H)). It is easy to check that 
|| 7 (P)- 7 (Q)|| <a\\P-Q\\, VP, Q G C„([0, T]; £(H)). 

Then, by the Contraction Mapping Principle, there exist unique P n and P in 
C u ([0,T]; E(H)) such that 

7 n{Pn) = P n and 7 (P) = P. 


However, as we do not assume that 


7 n(P)^7(P) mC u ([0,T}-E(H)), 

we cannot conclude that P n —> P in C„([0, T]; E(H)'), but a weaker result 
holds. 

Lemma 2.1. Under the previous hypotheses on the sequence of mappings 

{in}; 

P n * P inC 1 ([0 ) T];£(H)). 


Proof. Set 


P° = 0, P° = 0, 


and dehne 


pm =1 m {p 0 ); p- =7 - (P 0), TO = 1,2,.... 

By the Contraction Mapping Principle, we have 

lim P m = P, lim P™ = P„ in ([0, T]; P(P)), n = 1,2,.... 

m—> oo m—>oo 

Moreover 

OO OO 

||P-P m ||< ^a fe ||7 (P°)||, ||Pn-Pril< E afc H^( p0 )ll- 

k=m k=m 

Now fix x in H; then for all t in [0, T] 


| P(t)x - P n (t)x | < |P(t)a; - P m (t)x | + |P m (f)a: - P™(t)x| 

+ |P„ m (t)x-P„(t)x|. (2.4) 

Given e > 0, there exists m e £ N such that 

OO 

E« fe {ll7(P°)ll + ll7n(P 0 )||}<|, (2.5) 

k=m 

for all to > m e and all n £ N. By (2.4) and (2.5) it follows that 

\P{t)x-P n {t)x\< £ - + \P m *{t)x-P™*{t)x\, Vf e [0,r]. (2.6) 

Now (2.3) yields the conclusion. □ 
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2.2 Riccati equation 

Let A, B, C , and P$ be given linear operators such that assumptions (H) are 
verified. Consider the following Riccati equation: 

P' = A*P + PA- PBB*P + C*C, 

, x (2.7) 

P(0) = P 0 . y ; 

Problem (2.7) was studied by several authors when H, U, and Y are fi¬ 
nite dimensional. We recall the pioneering work in the early papers by 
R. E. Kalman [2] and W. M. Wonham [2]. The first systematic approach 
in the infinite dimensional case is due to J. L. Lions [3] who solved (2.7) by 
variational methods. Here we follow the direct approach by G. Da Prato [1]. 
For other results see D. L. Lukes and D. L. Russell [1], R. Temam [1], 
L. Tartar [1], and R. F. Curtain and A. J. Pritchard [1], 

As the operator A is unbounded it is not clear a priori what a solution 
of (2.7) means. We shall define now two kinds of solutions: mild solutions 
and weak solutions. It is also possible to define a notion of strict solution and 
classical solution. These definitions are more technical and will be given in §3. 
We first notice that if A € C(H), then, as is easily checked, problem (2.7) is 
equivalent to the following integral equation: 

P(t)x = e tA *P 0 e tA x+ [ e sA *C*Ce sA xds 

Jo 

e (t-')A*P( 8 ) BB * P ( s ) e {t-»)A xd8i xeH (2.8) 

Now (2.8) is meaningful for any A, which satisfies assumptions (H). In particu¬ 
lar the right-hand side of (2.8) belongs to the function space C s ([0, T]; S(H)) 
and it is natural to seek solutions in that space. 

Definition 2.1. 

(i) A mild solution of problem (2.7) in the interval [0,T] is a function P £ 
G s ([0,T];i7(i?)) that verifies the integral equation (2.8). 

(ii) A weak solution of problem (2.7) in the interval [0, T] is a function 
P € C s ([0, T]; S(H)) such that, P(0) = Pq and, for any x,y € D(A), 
(P(-)x,y) is differentiable in [0, T] and verifies the equation 

^( p (t)x,y ) = ( P(t)x,Ay ) + ( P(t)Ax,y ) 

- ( B*P(t)x , B*P{t)y) + (Cx, Cy). (2.9) 

□ 

Note that the choice of the space C s ([0,T]; S(H)) is natural because the 
mapping 1 1 —> e tA is in general strongly continuous but not uniformly contin¬ 



uous. 
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Proposition 2.1. Let P £ C s ([0,T]\ £(H)). Then P is a mild solution of 
problem (2.7) if and only if P is a weak solution of (2.7). 

Proof. If P is a mild solution of (2.7), then for any x, y £ D(A) we have 

(. P{t)x,y ) = (P 0 e tA x,e tA y)+ f ([< C*C-P(s)BB*P(s)]e^- s '> A x,e^- s)A y) ds. 

Jo 

It follows that ( P(t)x , y) is differentiable with respect to t and, by a simple 
computation, that (2.9) holds. Conversely if P is a weak solution, then it is 
easy to check that for all x, y £ D(A ) 


4~(P{s)e (t - s)A x,e (t - a)A y) 

ds 

= (fCe {t - s)A x,Ce {t - s)A y)- {B*P{t)e^- s)A x,B*P{t)e ( - t - s)A y). 
Integrating from 0 to t we obtain 


(P(t)x,y)=(e tA *P 0 e tA x, y)+ f (e^~ s)A * [C*C-P{s)BB*P{s)} 

Jo 

for all x, y £ D{A). As D(A) is dense in H, (2.8) follows. 

It is useful to introduce the approximating problem: 

f P' n = A*P n + P n A n - P n BB*P n + C*C, 

\ P n (0) = Po, 


e (t ~ s)A x, y) ds 

□ 

( 2 . 10 ) 


where A n = n 2 R(n, A) — nl is the Yosida approximation of A and R{n , A) 
is the resolvent of A. Problem (2.10) is obviously equivalent to the following 
integral equation: 


„sA n 


ds 


P n {t) = e tA "P 0 e tAn + f e sA "C*Ce s 

Jo 

- f e {t - s ' )A ^P n {s)BB*P n (s)e {t - s)An ds. 

Jo 

We now solve problem (2.7). We first prove the local existence of a solution. 
Lemma 2.2. Assume that (' TL ) is verified, fix T > 0, set 

r = 2 M|||P 0 ||, (2.11) 


and let t be such that 

r £ ]0, T\, T(\\C\\ 2 +r 2 \\B\\ 2 )< ||Po||, 2 tM 2 t <\, (2.12) 

where Mt has been previously defined just below (2.2). Then problems (2.7) 
and (2.10) have unique mild solutions P and P n in the ball 
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B rtT = {F€C u ([0,T]-,2(H)): ||P|| < r}. 


Moreover 

lim P n = P inC s ([0,T];S(H)). (2.13) 

n—> oo 

Proof. Equation (2.8) (resp. the integral version of (2.10)) can be written in 
the form 

P = 7 (P) (resp. P n = 7 n (P„)), 

where for x £ H 

7 (P)(t)x = e tA *P 0 e tA x + [ e (t " s)A * [C*C - P(s)BB*P(s)}e { - t ~ s)A x ds 

Jo 

and 

7 n (P)(t)x = e tA "P 0 e tAn x + f e {t ~ s)A ^[C*C - P{s)BB*P{s)}e {t ~ s)An xds. 

Jo 

Choose now r and r such that (2.11) and (2.12) hold. We show that 7 and 7 n 
are ^-contractions on the ball P r , T of C„([0, r]; S(H)). Let in fact P € P r , T . 
Then, recalling (2.2), we have 


| 7 (P)(^|<M|{||Po||+r[||C|| 2 +r 2 ||B|| 2 ]}|^| 

< 2M 2 ||P 0 || |*|, 

and analogously 

\ln(P)iJ)x\ < 2M 2 ||P 0 || |a:|. 

It follows that 


|| 7 (-P)(t)|| < r, || 7 „(P)(t)|| <r, Vf <E [0, r], n G N, P € P r>T 


so that 7 and map P r , T into P rjT . 
For P,QG B r T we have 


j(P)(t)x-'y(Q){t)x 



e {t - s)A *[P BB *(Q-P)+(Q-P) B B*Q](s) e {t - s)A xd s, 


and a similar formula holds for 7 n (P)(t)x — 7 n (Q)(t) x - It follows that 


UP)(t) - 7(Q) WII < 2 rM 2 r||P|| 2 ||P - Q\\ < |||P - Q||, 
117 n(P)(t) - 7n(Q)WII < 2 rM 2 r||P|| 2 ||P - Q|| < |||P - Q||. 


Thus 7 and 7 „ are ^-contractions in B r T and there exist unique mild solutions 
P and P n in B r T . Finally (2.13) follows from Lemma 2.1. □ 

We now prove global uniqueness. 
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Lemma 2.3. Assume that (Tt) is verified, let T > 0, and let P, Q be two mild 
solutions of problem (2.7) in [0,T]. Then P = Q. 

Proof. Set 

a= sup max{||P(t)||, ||Q(t)||}; 
te[o,T] 

a is finite by the Uniform Boundedness Theorem. Choose r > 0 and r € [0, T] 
such that 


r = 2M^a, t(\\C\\ 2 + r 2 \\B\\ 2 ) < a, 2rM^r < |. 

By Lemma 2.2 it follows that P(t) = Q(t) for any t £ [0, t\. It is now sufficient 
to repeat this argument in the interval [r, 2r] and so on. □ 

The main result of this section is the following theorem. 

Theorem 2.1. Assume that (TL) is verified. Then problem (2.7) has a unique 
mild solution P £ C s ([0, oo[; E + {H)) . Moreover, for each n £ N, problem 
(2.10) has a unique solution P n £ C([0, oo [■,E + {H)) and 

lim P n =P inC s ([0,T]-E(H)), 

n—> oo 

for any T > 0. 

Proof. Fix T > 0, set (3 = M|,(||Po|| +T||C|| 2 ), and choose r > 0 and r £ ]0, T] 
such that 

r = 2f3Ml T(\\C\\ 2 +r 2 \\B\\ 2 )<p, 2rrM* < |. 

By Lemma 2.3 there exists a unique solution P (resp. P n ) of (2.7) (resp. 


(2.10)) in [0,r], and P n - 

P in C s ([0,t]; E(H)). We now prove that 



P n (t)> 0, Vt £ [ 0 ,rj. 

(2.14) 

This will imply that 

P(t)> 0, Vt £ [0, t]. 

(2.15) 


To this end we notice that P n is the solution of the following linear problem 
in [ 0 ,r]: 

P' n = L* n P n + P n L n + P n (0) = P 0 , 

where L n = A. n — \BB*P n . Denote by U n (t, s), 0 < s < t < t, the evolution 
operator associated with L* (see Part II, Chapter 1 §3.5). Then we can write 
the solution P n (t) as 

P n (t) = U n (t,0)P 0 U*(t,0)+ [ U n {t, s)C*C U*(t, s) ds. 

J 0 

Thus (2.14) and (2.15) follow immediately. 

We now prove that, for n large enough, we have 
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P(t) < (31, P n (t)<01, Vte[0,r]. (2.16) 


These inequalities will allow us to repeat the previous argument in the interval 
[r, 2r] and so on. In this way the theorem will be proved. We have in fact 

(P n (t)x,x) = (Poe tAn x, e tAn x) + f \Ce sAn x\ 2 ds 

Jo 

\B*P n {s)e {t - s)A "x\ 2 ds < (3\x\ 2 . 

As P n (t) > 0 this implies (2.16). The proof is complete. □ 

We now prove continuous dependence with respect to the data. Consider a 
sequence of Riccati equations 



| (p*)' = A* k P k + P k A k - P k B k B* k P k + C* k C k , 
\P k (0) = P k , 

under the following hypotheses: 

(i) for any k € N, (A k , B k ,C k , P k ) fulfill (H), 

(ii) for all T > 0 and all x € H, 

lim e tAk x = e tA x uniformly in [0, T], 

k—> oo 

(iii) for all T > 0 and all x £ H, 

lim e tAk x = e tA x uniformly in [ 0 ,T], 

k—> oo 

(iv) the sequences {B k }, {B k }, {Cfc}, {C k }, {P 0 fc } are 
strongly convergent to B, B*, C, C*, Pq, 
respectively. 


(2.17) 


(2.18) 


Theorem 2.2. Assume that (H) and (2.18) hold. Let P and P k be the respec¬ 
tive mild solutions to (2.7) and (2.17). Then, for any T > 0, we have 

lim P k = P inC s ([0,T]-H). (2.19) 

k—* oo 

Proof. Fix T > 0. By the Uniform Boundedness Theorem there exist positive 
numbers p. b , and c such that 

||P 0 fe U<P, II CtC k \\<c, || B k B* k \\<b, Vfc e N. 

Set /3 = M%,(p + cT) and choose r and r G ]0, T] such that 

r = 2 Mt/3, t(c + r 2 b) < (3, 2 M^t < \. 

Then, arguing as we did in the proof of Lemma 2.2 we can show that P k {-)x —> 
P(-)x in C([0,T];i7) for any x in H. Finally, proceeding as in the proof of 
Theorem 2.1, we prove that this argument can be iterated in the interval 
[r, 2 r] and so on. □ 
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We conclude this section by proving an important monotonicity property 
of the solutions of the Riccati equation (2.7). 

Proposition 2.2. Consider the Riccati equations: 

jp; = A* Pi + P t A - PiB,j B*F\ + C*Ci, 

\p i (0) = P ii0 , *=1,2. 

Assume that (Ai, Bi, Ci, Pip), verify {TL) for i = 1,2 and in addition that 
Pi,o < P 2 ,o, CfC 1 < C$C 2 , B 2 B* < B X B\. 


Then we have 

Pi(t)<P 2 (t), t > 0. (2.21) 

Proof. Due to Theorem 2.1 it is sufficient to prove (2.21) when A is bounded 
(because we can approximate A with the sequence of bounded operators A n ). 
Set Z = P 2 — P\\ then, as easily checked, Z is the solution to the linear 
problem: 


Z' = X*Z + ZX- P 2 [B 2 B * - PiP*]P 2 + C*C 2 - CfCf, 
Z (0) = P 2 ,0 — Pi ,0 ; 


where 

X = A-\B 1 Bl{P 1 +P 2 ). 

Let V(t, s ) be the evolution operator associated with X*. Then we have 

Z(t) = V(t,0)(P 2 ,o - Pi, o )V*(t,0) + [ V(t, s){C 2 C 2 - CfCi}V*(t, s) ds 

Jo 

+ [ P(t,s)Pi(s)[PiP*-P 2 P*]Pi(s)P*(t,s)ds 
Jo 

so that Z(t) > 0 and the conclusion follows. □ 

2.3 Representation formulas for the solution of the Riccati 
equation 

We want here to give an explicit formula for the solution of the Riccati equa¬ 
tion (2.7). In fact several variants are possible; see A. V. Balakrishnan [4] 
and I. Lasiecka and R. Triggiani [1, 3]. 

We assume that (7d) is verified and introduce the operator 

K t e £(L 2 (0,f;P);P 2 (0,f;P)) 


defined by 
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(K t x)(s) = f e^ p s ' )A x(p)dp, x £ L 2 (0,t; H), s€ [0,1]. 

J S 

Its adjoint Kf £ C(L 2 (0, t; H)\L 2 ( 0, t; H )) is given by 

(Kfx)(s) — f e^ s_ °'^' 4 x(a)da, s € [0 ,t]. 

Jo 

In fact K t ,Kf £ £(L 2 (0, t; H)\ C([0, t}\H)) (with K* not representing the 
dual for these functional spaces). Therefore we can define K^£C(L 2 (0, t; H); H) 
as the operator 

K®x = (K t x)(0) = ( e pA x(p)dp, x£L 2 (0,t-H), 

Jo 

and its dual (Jv°)* g C(H;L 2 ( 0, f; H )) is given by 

[(K°yh]{s) =e sA *h, h £ H. 

We can assert the following proposition. 

Proposition 2.3. Assume that ( hi) is verified, and let P be the mild solution 
of (2.7). Then one has the formula 


P(t) = [l+(KfC*CK t + {K^yPoK^BB*}- 1 

x \KfC*Ce (t - )A + (K°yP 0 e tA ](t). (2.22) 


Proof. We first clarify the meaning of the right-hand side of (2.22). For fixed t, 
i s the operator in C(H;L 2 ( 0, t ; H )) defined by /z i —> e^ t ~ s ' )A h, s g ]0, t[. 
Next C g C{H\Y) is identified with an element of £(L 2 (0, t; H)\ L 2 (0, t; V)) 
defined by 


Ca:(-)(s) = Cx{s). 


Similarly B g C(L 2 (0, t.; [/); A 2 (0, t; H)) and analogous considerations hold 
for C*, B* . Then the operator 


A t = I + (KfC'*CK t + ( K°yP 0 K t )BB* 


is an element of C(L 2 (0, t: H)-,L 2 ( 0, t ; H)), which even belongs to £(L 2 (0, f; H)\ 
C([0, f]; H)) . According to Proposition 1.1 in Appendix A, it is invertible and 

Af 1 £ C(L 2 (0,t;H)-C([0,t];H)) 


and finally 

Af 1 [Kt C*Ce^J A + (I<°yP 0 e tA } £ C(H-,C([0,t]-,H)), 


and it makes sense to take its value at time t, defining in this way an element 
of C{H ), and therefore (2.22) has a meaning. 
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We shall proceed with the formal derivation of (2.22). The rigorous deriva¬ 
tion is first done for the approximation ( 2 . 10 ), where the formal computations 
are valid, because A n is bounded, and then the final result is obtained by going 
to the limit. Define X(t, s ) to be the solution of the problem 

= P - »)■ «<<<»• (223) 

Define next 

Z{t,s) = P{s)X(t,s). 

An easy computation (from the Riccati equation and (2.23)) shows that the 
pair X(t, s), Z(t , s) is the solution of the Hamiltonian system 

_dX^s) = Ax _ BB * z , t x 

OS 

< dZ(t, s) = Ai , + c* cx ^ a ) (2.24) 

OS 

,Z(t, 0) = PoX(t, 0), X(t,t) = I. 


Therefore we have 


Z(t,s) =e sA *P 0 X(t 1 0)+ [ e( s -^ A *C*CX(t,a)da, 

X(t, s) = e {t ~ s)A - f e {p ~ s)A BB*Z(t, p) dp, 

J S 

and combining the two relations we obtain 

Z(t, s) = e sA * Pq |e tA - J e pA BB* Z(t, p) dpj 

+ J e {s ~ a)A *C*C ^e {t ~ a)A -J e {p ~ a)A BB*Z(t,p)dp^ da. 
Setting Z t (s) = Z(t,s ) G £(L 2 (0, t; H); T 2 (0, t; H )), this relation reads as 


Z t + (K A )*P 0 KtBB*Z t + K*C*CK t BB*Z t = K*C*Ce {t — )A + (A"°)*P 0 e tA . 
As P(t) = Z t (t) = Z(t,t), we obtain formula (2.22). □ 


3 Strict and classical solutions of the Riccati equation 

In this section we are interested in strict and classical solutions of the Riccati 
equation. The section is divided into three subsections, namely the general 
case, the case when e tA is an analytic semigroup, and finally the case when A 
is a variational operator. In §3.1 and §3.2 we follow G. Da Prato [1]. 
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3.1 The general case 

In order to define strict solutions to (2.7), we need to give a precise meaning 
to the linear mapping A: T i—> A(T) = A*T + TA. For any T £ E(H) we set 

<Pt(x, y) = (' Tx , Ay) + (. Ax,Ty ), x, y £ D(A) (3.1) 

and define 

D(A) = {T £ E(H): (fix is continuous in H x H}. (3.2) 

If T £ D(A) then Lpx has a unique extension (which we still denote by ipx) 
as a continuous sesquilinear form in H x H. In this case there exists a linear 
operator that we denote by A(T) £ E(H) such that 

(A(T)x,y) = ip T (x,y), x,y £ D(A), T e D(A). (3.3) 

Thus we have defined a linear operator from D(A) C £(H) —> £{H). It is 
easy to check that A is closed in S(H). However D(A) is not dense in £{H) 
in general. The following proposition shows the relationship between A{T) 
and A*T + TA . 

Proposition 3.1. Let T £ D{A). Then for any x £ D(A) we have Tx £ 
D(A*) and 

A(T)x = A*Tx + TAx. (3.4) 

Proof. For any x, y £ D(A) we have 

(Tx, Ay) = ip T (x,y) - (Ax,Ty). 

It follows that, for x £ D(A), the linear mapping 

y !->■ (Tx, Ay): D(A) -> C, 

is continuous for H. This implies that Tx £ D(A*) and for all y £ H 

(A(T)x, y) = ip T (x, y) = (A*Tx, y) + (TAx, y), 

which proves (3.4). □ 

Remark 3.1. We define a semigroup on S(H) 

e tA {T) = e tA *Te tA , t > 0, T £ S{H). (3.5) 

Notice that e tA is not strongly continuous in general (this should imply that 
e tA (T) —> T as t —> 0 in C(H)). However it is easy to see that 

e tA (T)x -^Tx as t -» 0, \/x £ H, VT £ E(H). □ 
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We now return to the Riccati equation (2.7), which we write in the form 
P' = A(P) - PBB*P + C*C, P(0) = P 0 . (3.6) 

We say that P is a strict solution to the Riccati equation (2.7) (or (3.6)) if 
( (i) PeCi([0,oo[; 27(H)), 

l (ii) P(t) G D(A), Vf > 0, (3.7) 

[ (iii) A{P) G C s ([0,oo[; 27(H)) and (3.6) holds. 

Remark 3.2. Assume that P is a strict solution of problem (2.7). By Propo¬ 
sition 3.1 it follows that for any x G D(A), P(t)x G D(A*) and the following 
equation holds: 

P'(t)x = A*P(t)x + P(t)Ax - P(t)BB*P(t)x + C*Cx. (3.8) 

By (3.8) one can easily check that P is a weak solution of problem (2.7). Thus, 
by Proposition 2.2, a strict solution is a mild solution of (2.7). □ 

Proposition 3.2. Assume that (H) is verified and that Pq G D{A). Then the 
Riccati equation (2.7) has a unique strict solution. 

Proof. Uniqueness follows from Theorem 2.1. Let us prove existence. Fix T > 
0 and let P (resp. P n ) be the mild solution of (2.7) (resp. (2.10)). Set 

A n (S) = A* n S + SA n , n > u>, S G 27(H), 

where the A n ’ s are the Yosida approximations of A and u> is given in (2.2) 
(note that the A n 's are not the Yosida approximations of A). We have 

{Pf= A n (P n ) - P n BB*P n + C*C, 

\P n (0) = P 0 . 

Moreover V n = P' n is the solution of the problem 

\v’ n = Anfi V n ) - P n BB*V n - V n BB*P n , 

114(0) = A n (Po) - P 0 BB*P 0 + C*C. 

We want to show that V n (-)x is convergent, as n —> oo, to V(-)x in C([0,T]; H), 
where V is the solution to the following linear integral equation: For all x in 


V(t)x = e tA * V(Q)e tA x — / e {t - s)A *[P{s)BB*V{s)+V(s)BB*P(s)}e^ s)A xds, 

Jo 

which can be easily solved by successive approximations. In fact, by using 
similar arguments as in the proof of Lemma 2.2, it follows that 
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Pn^P, V n ^V mC s ([0,T]-,H). 

As V n = P' n , we have that P £ Cj ([0, T];H). It remains to show that P(t) £ 
D(A) and that (3.6) holds. Fix t > 0 and let x, y £ D(A). We have 

(x, y) = (P{t)x, Ay) + ( Ax,P{t}y ) 

= lim [(P n (t)x, A n y) + (A n x, P n (t)y)] 

n—>oo 

= lim (A n (Pn(t))x, y) 

n—> oo v v 77 

= lim [(V n (t.)x,y) + (P n (t)BB*P n (t)x,y) - (C*Cx,y)] 

n—> oo L v 7 v 7 

= (V(t)x,y) + (. P(t)BB*P(t)x,y ) - (C*Cx,y). 

It follows that P(t) £ D(A) and 

A(P(t)) = P'(t) + P(t)BB*P(t) - C*C. □ 

3.2 The analytic case 

We assume here that the semigroup e tA is analytic. Then there exists c > 0 
and 7 > 0 such that 

\\e tA "\\ < ce^, \\A n e tA "\\<- t et \ 0 < t < 1. (3.9) 

As e tAn (T) = e tA "Te tA ", VT £ C(H), it follows that 

He*- 4 " || < c 2 e 2t \ || A n e tA - 1| < ^e 2t ^, 0 < t < 1. (3.10) 

Moreover the semigroup e tA , defined by (3.5), is clearly analytic for t > 0. 

We now introduce the notion of classical solution. We say that P £ 
Cs([ 0 ,oo[; S(H)) is a classical solution of the Riccati equation (2.7) if 

! (i) for any t > 0, P(t) is differentiable, P(t) £ D(A) and 
P'(t) = A(P(t)) - P(t)BB*P(t ) + C*C, t > 0, 

(ii) P(0) = P o . 

Proposition 3.3. Assume that (7 i) is verified and that e tA is an analytic 
semigroup. If P £ C s ([0, oo[ ;S(H)) is a classical solution of (2.7), then P 
is a weak solution and a mild solution of (2.7). 

Proof. Let P be a classical solution, let x,y £ D(A ), and let t > 0. By 
Proposition 3.1 we have P(t)x £ D{A *) and 

A(P(t))x = A*P(t)x + P{t)Ax. 

It follows that 
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±(P{t)x,y) = ( P(t)x,y ) + ( P(t)Ax,y) - (. B*P(t)x,B*P(t)y ) + (Cx,Cy) 

for all t > 0. By integrating this identity between e > 0 and t, and letting 
£ tend to 0, we find that P is a weak solution and then a mild solution of 
(2.7). □ 

Remark 3.3. By Proposition 3.3 it follows that there exists at most one clas¬ 
sical solution of (2.7). □ 

Theorem 3.1. Assume (7 i) and that e tA is an analytic semigroup. If P £ 
C's ([ 0 , °o[ ; E(H)) is the mild solution of (2.7), then P is a classical solution 
and belongs to C°° ([e, oo[; E(H)), Ve > 0. 

In order to prove Theorem 3.1 we need the following two lemmas. 
Lemma 3.1. Assume that e tA is an analytic semigroup. Let E £ C s ([0,T]; 
E(H)j for some T > 0, and let F be defined by 

F(t)x = [ e (t “ s)A * E{s)e^- s)A xds, x £ H. 

Jo 

Then for any a £ ]0,1[, we have F £ C a ([0, T]; E(H)) and there exists a 
constant Ct > 0 such that 

I F (t)x - F(r)x | < C T \t - r\ a \\E\\c([om}-s(H))\x\, 

for all t.,r > 0. 

Proof. Let x £ H and 0 < r < t < T. We have 

F(t)x — F(r)x = f e < ' t ~ s ^ A (E(s))xds+ f f (Ae aA )(E(s))xda. 

Jr J 0 J r—s 

Taking into account (3.10) we have 

||F(t)-F(r)||<c 2 e 2 ^{|t-r|+ /' ds f *-) \\E\\. 

L J 0 Ji—s ® J 

As 



, f l ~ s da 
ds — < 
J r — s cr 



s)~ a ds f a**- 1 da < -\t-r\ a [ (r-s)~ a ds, 
J r—s ^ Jo 


the conclusion follows. 


□ 


Lemma 3.2. Assume that e tA is an analytic semigroup. Let a £ ]0,1[, M £ 
C a ([0, T]; E(H)), and let G be defined by 

G(t)x = [ e^- 8 ^* M{s)e {t - s)A xds, x £ H. 

Jo 

Then G £ C 1 ([0, T]; E(H)) n C([0, T]; D{A)) and 

C(t) = A(G(t)) + M(t). 


(3.11) 
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Proof. Set 


G n {t)x = f e s ^ An (M(s))x ds. 

Jo 


Then we have 


G' n (t)= [ - 4 ne (*-«M»(jif(s)-M(t))ds + e M "(M(t)). (3.12) 

Jo 

By using (3.10) we have 

\\A n e^ A "(M(s)-M(t))\\<2c 2 e 2 ^\t-s\ a - 1 \\M\\ a , (3.13) 

where 

\\M\\ a = sup i!— 

0 <t<s<T 1 1 - S\ 

By (3.12) and (3.13), it follows that G £ C 1 ([0, T]; S(H)) and 

G'(t)x= f Ae^ t ~ s ^ A (^M(s) — M(t))xds + e tA {M{tf)x. 

Jo 

Finally, arguing as we did in the proof of Proposition 3.2, we find that G £ 
C([0,T];D(A)) and that (3.11) holds. □ 

Proof. Proof of Theorem 3.1. Let P be the mild solution of (2.7), which we 
write in the form 


P(t)x = e tA *P 0 e tA x+ f e {t ~ s)At E{s)e^~ s)A x ds, (3.14) 

Jo 

where x £ H and E = C*C — PBB*P. As e tA * P§e tA is analytic in t for t > 0, 
from Lemma 3.1 we have P £ G“([e, T\; E(H)) for 0 < £ < T, a € ]0,1]. 
Moreover for all x in H and t > e 


P(t)x = e {t ~ e)A *P(£)e {t ~ E)A x + J e {t - s)A *E{s)e^- s)A xds. 

From Lemma 3.2, it follows that 

P £ C 1 ([2e,T]-, E(H)) nC([2e,T]; D(A)), 0 < 2 e < T, 

which implies E £ G 1 ([2e,T]; £(H)). Moreover, by the identity 

P(t)x = e {t - 2e)A 'P(2s)e^- 2e)A x + [ e aA 'E(t - a)e aA x da, x £ H, 

J 2e 


with t > 2e, it follows that P £ G 2 ([3e, T]-,E(H)), 0 < 3e < T. By repeating 
this argument several times we find P £ C°° ([e,T]; E{H)), for any e > 0, as 
required. □ 
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The next corollary follows easily from (3.9). 

Corollary 3.1. Assume that (7 i) is verified and let e tA be an analytic semi¬ 
group. Let P £ C s ([0, oo[; H) be the classical solution to (2.7). Then P belongs 
to C(\e, oo[; C(H\ D((-A*y- e ))) for all e £ ]0,1[. 

Theorem 3.2. Assume that (7 i) is verified and that the semigroup e tA is 
analytic in the sector Sg = {A £ C: | argA| < 0} for some 8 £ ]0,7 t/2 [. Let P 
be the classical solution of problem (2.7). Then P has an analytical extension, 
as a function with values in S(H), on the sector Sg. 

Proof. Define r and r as in (2.12). Then by Lemma 2.2 we have 

P(-)x = lim P^ m \-)x in (7([0 ,t]; H), x £ H, 

m —xoo 

where p( m > are defined by recurrence as 
P {0 \t)x = e tA * P 0 e tA x 

P {m+1) (t)x = e tA *P 0 e tA x + f e (t ~ s)A 'C*Ce {t ~ s)A xds 

Jo 

e (t-s)A* p(m) ( s ) BB*p( m ) ( s)e {t ~ s)A x ds. 

Clearly p( m ) (•)x are analytic in Sg. Thus by a classical result, P(-)x is analytic 
in Sg for any x £ H. This yields the conclusion (see for instance A. E. Tay¬ 
lor [1], Theorem 4.4.F). □ 

3.3 The variational case 

We consider here the situation described in Chapter 2 of Part II. We assume 
that there exists a Hilbert space V such that V C H, algebraically and topo¬ 
logically, and V is dense in H. Moreover, H is identified with its dual, and 
V C H C V 7 , where V is the dual of V. We denote by (-, •) the duality pair¬ 
ing between V and V' and by || • || the norm on V (recall that | • | and (•,•) 
represent the norm and the scalar product in H). Let a: b x b -4 R be a 
V-H coercive continuous bilinear form; that is 

3cc > 0, 3A £ R, \/xGV, a(v, v) + A|r;| 2 > a||u|| 2 . 

Let —A: D(A) C H —> H be the operator generated by a 

— (Av,v)=a(v,v), Vu £ D(A), 

and denote by A\ the operator A — XI. The operator A\, as well as A, is 
the generator of an analytic semigroup on H (cf. Part II, Chapter 1, §2.7, 
Theorem 2.12). Moreover we have seen that when 
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D A (\,2)=D A *{\,2), 

then 

D A {\, 2) = D((-A x y/ 2 ) =V = 2 ) = D A * (±, 2) 

(cf. Part II, Chapter 2, §1.5, Proposition 1.1). 

We shall need the following result due to F. Flandoli [6], which is true 
for arbitrary variational operators. 

Lemma 3.3. Let A be a variational operator in H. Then for any T > 0, there 
exists Kt > 0 such that 

f |(— A) l ^ 2 e tA x\ 2 dt < Kt\x\ 2 , \/x € H. (3.15) 

Jo 

Proof. For variational operators we know from the result of A. Yagi [1] (cf. 
Part II, Chapter 1, Theorem 6.1) that D A {\, 2) and D((— A) 1 / 2 ) are isomor¬ 
phic. It is sufficient to prove (3.15) for all x G D(A ); if x G D(A), we have 

/ \(~A) 1/2 e tA x\ 2 dt= j \Ae tA (-Ay 1/2 x\ 2 dt<\{-A)- 1/2 x\ 2 DA{1/2 2) . 
Jo Jo 

As D a (t), 2) is isomorphic to £>((—A) 1 / 2 ), the conclusion follows. □ 

In this case we have the following additional regularity result. 

Theorem 3.3. Assume that (Tt) is verified, and let A be a variational oper¬ 
ator. Let P £ C s ([0,oo[ ; H) be the classical solution to (2.7). Then for any 
t > 0 and x £ D((—A) 1 / 2 ) we have P(t)x £ D((—A*) 1 / 2 ) and the mapping 
(-A*) 1 / 2 P(-)(-A) 1 / 2 X is continuous for t > 0. 

Proof. Let x £ D((— A) 1 / 2 ) and let P be given by (3.14); then we have 
(P(t)(-A) 1 ^ 2 x, (-A) 1//2 x) = (Po(—A) 1 / 2 e tA x, (-A)V 2 e tA x) 

+ f (E(s)(-A) 1 / 2 e {t - s)A x, {-Af^e^-^x) ds 
Jo 

<||P 0 || ||(-A) 1 /2||2| e M a; |2 + || E || /■|(_ A) l/2 ^2^ 

Jo 

It follows, recalling (3.15), that 

\(P{t)(-A) 1/2 x,(-A) 1/2 x)\ < c l e ^ T \\(- A y/ 2 \\ 2 \x\ 2 + \\E\\K T \x\ 2 , 

which yields the conclusion. □ 

So when A is a variational operator generated by a continuous and coercive 
bilinear form a such that 

D((-A) 1/2 ) = D((-A*) 1/2 ), 

Theorem 3.3 says that for all f > 0 the operator P[t) belongs to C(V'; V ). 
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4 The case of the unbounded observation 

In this section we consider the case when the observation C is unbounded. 
More precisely we make the following assumption: 


(#)-(' 


(i) c e c(d(A)\Y) 

(ii) 3 a real continuous function K such that 

f \Ce sA x\ 2 ds < K(t)\x\ 2 , \/x € D(A). 

Jo 


Clearly, if (if)-(v) holds, then for any t > 0, there exists a linear operator 
Fc(t ) e £ + {H) such that 

(F c (t)x,y) = [ ( Ce sA x,Ce sA y)ds, Mx,y € D(A). (4.1) 

Jo 

Lemma 4.1. Assume that (ff)-(v) is verified, and let Fc(-) be defined by 
(4.1). Then Fc € C s ([0, +oo[ ;T + (ft)). Moreover, setting 

F c ,n(t)x= f e sA ' (CJ n )*CJ n e sA xds, x € H, 

Jo 

where J n = nR(n , A), one has for all T > 0 

lim F c>n (-) = F c (-), 


inC s ([0,T];E(H)). 

Proof. Let to € [0, +oo[, t > to, and x € D(A)-, then we have 
J ( F(t ) — F(to))x = (F(t)x—F(to)x,x) = f \Ce sA x\ 2 ds — > 0, as t —> to- 

v Jt 0 

As D(A) is dense in Ft we have 

hm yj (. F{t ) - F(t 0 )) x = 0 

for all x £ H. Consequently, the first part of the lemma follows easily. The 
last part follows immediately because 

Fc,n{t) = Jn Fc Jn • □ 

We consider now the Riccati equation in the integral form 

P(t)x = e tA *P 0 e tA x + F c (t)x- f P(s)BB*P(s)e {t - s)A xds (4.2) 

Jo 
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and the approximating equation 


P n (t)x = e tA " 


P 0 e tAn x + F c , n (t)x 

- f e {t - s)A *P n {s)BB*P n {s)e { - t - s)An xds, 


Jo 


n G N. (4.3) 


Equation (4.3) has clearly a unique solution P n G C ([0, oo[; S + (H)), which 
is also the solution of the problem 


P'n = A*P n + P n A n - P n BB*P n + ( CJ n fCJ n , 
Pn(0) = P 0 . 


We now prove the following theorem. 

Theorem 4.1. Assume that (H) -(i)-(ii)-(iii)-(v) are verified. Then (4.2) has 
a unique solution P G (^([(boo [; E + (H)) and 

lim P n (-) = P(.) inC s ([0,T]-,E(H)), VT > 0. (4.4) 

n—> oo v 7 

Proof. The proof is similar to the one of Theorem 2.1, with minor differences. 
Fix T > 0, set 


L T = sup ||Tb,n(t)||, r = 2{Mj.\\P 0 \\+L T ), 

te[ 0 ,T],nSN 

and choose r G [0, T] such that 

rr 2 M|||B || 2 < M|||P 0 || + L T , 2 rrM| < 


Now set 

7 {P){t)x = e tA *P 0 e tA x + F c {t)x - [ e ( ‘- s)A *P(s)PP*P(s)e (t - s)A xds, 

Jo 

and let 7 „(P) be defined in a similar way. Then 7 and 7 „ are ^-contractions 
on the ball 

{PgC s ([0,t\-,H): ||P(t)|| <r,Vte [0 ,t]}. 

Thus there exists P (resp. P n ) such that 7 (P) = P (resp. 7 „(P„) = P„) and 
P (resp. P„) is the unique solution of (4.2) (resp. (4.3)) in [0,r]. Now, by 
Lemma 2.1, it follows that 

lim P„(-)=P(-) in C s ([0, r]; P(P)). 

n—► 00 


This yields P(f) > 0, V< G [0,r]. From now on the proof is completely similar 
to the one of Theorem 2.1. □ 
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4.1 The analytic case 

We choose once and for all Ao > u> and set A\ 0 = Ao — A. We assume besides 
('H)-(i)-( ii )-(iii) 

(W)-(vi) A is the infinitesimal generator of an analytic semigroup, 

(W)-(vii) there exists a £ [0, such that C £ £(D(Af o );Y). 

We remark that (7d)-(vi)-(vii) imply that there exists a constant K a > 0 such 
that (see Part II, Chapter 1, §5, Theorem 5.2) 

\\Ce tA \\ < K a e ut t~ a , t > 0. 

It follows that (H)-(v) holds true and so we have the following straightforward 
generalization of Theorem 2.1. 

Proposition 4.1. Assume that (7d)-(i)-(ii)-(iii)-(vi)-(vii) are verified. Then 
the Riccati equation (2.7) has a unique mild solution P £ C s ([0, oo[ ; E + (H)). 

4.2 The variational case 

As in §3.3, we are given a variational operator A , which is V-H coercive for 
some a > 0 and A £ R. We assume that V is isomorphic to Z)((—A) 1 / 2 ) and 
to D((— A*) 1 / 2 ). We assume in addition that 

. (W)-(viii) C £ C{V\Y). 

In fact this framework corresponds to the limit case of the situation considered 
in §4.1, with a = If (7d)-(viii) holds, then by Lemma 3.3, it follows that 
(H)-(v) is also fulfilled. Thus we have the final result. 

Proposition 4.2. Assume that (7t)-(i)-(ii)-(iii)-(viii) are verified. Then the 
Riccati equation (2.7) has a unique mild solution P £ (7 S ([0, oo[ ; S+(H)). 


5 The case when A generates a group 

We shall denote by C r {H) the set of elements in C{H) that have a continuous 
inverse. It is well known that £ r (H) is open in £(H). 

In this section we assume (TO) and in addition that A is the infinitesimal 
generator of a strongly continuous group of operators. This is equivalent to 
say that A fulfills (7t)-(i) and —A generates a Co semigroup e~ tA . Besides 
Riccati equation (2.7) we shall consider the following: 

(q' = -aq-qa*-qc*cq + bb*, 

\Q(0) = Qo. 

We shall show that, as proved in F. Flandoli [2], when Qo = P^f 1 , then we 
have Q(t) = P -1 (f). We first consider the case when A is bounded. 
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Proposition 5.1. Assume that (Tt) is verified, that A G T(H), and that Pq G 
C r (H). Let P(-) be the mild solution of (2.7) and Q(-) the mild solution of 
(5.1) with Qo = Pq 1 - Then P(t) G C r (H) for all t > 0 and we have 

P(f) _1 = Q(t), \/t > 0. 


Proof. Set A = PQ — /; as easily checked we have 

f A' = (A* - PBB*)A - A(A* - C*CQ) =: L(A), 

M(0) = 0 . 


As L is a linear bounded operator in C(H) we have Aft) = 0, Vi > 0 and so 
P(t)Q(t ) = I, Vt > 0. In a similar way one shows that Q(t)P(t) = /, Vt > 0. 

□ 

We prove now the main result of this section. 

Theorem 5.1. Assume that (Tt) is verified, that A generates a strongly con¬ 
tinuous group in H, and that Pq G C r (H). Let P(-) be the mild solution of 
(2.7) and Q(-) the mild solution of (5.1) with Qo = Pq 1 ■ Then P(t) G C r (H) 
for all t > 0 and we have 

P(t)~ 1 = Q(t), \/t> 0. 


Proof. Denote by P n and Q n the solutions of problems (2.7) and (5.1) with 
A replaced by the Yosida approximants A n , bGN. By Theorem 2.1 we have 


lim P n = P, lim Q n = Q 

n—> oo n—>■ oo 

in C s ([0, T]; E + (H)^ for all T > 0. By the previous proposition it follows that 

P n 1 (t) = Qn(t), Vf> 0. 

Letting n tend to infinity on the equality 

Pn(t)Qn(t)x = Qn(t)Pn(t)x = X, X G H, 


the conclusion follows. 


□ 


6 The linear quadratic control problem with finite 
horizon 

6.1 The main result 

In this section we consider the control problem (1.1)—(1.2). We assume that 
(Tt) is verified and denote by P G C s ([0, oo[ ; E + (H )) the mild solution of the 
Riccati equation (2.7). We first consider the closed loop equation 


x’(t) = Ax(t) - BB*P(T — t)x(t), t G [0,T], 
x(0) = xq G H. 


( 6 . 1 ) 
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Proposition 6.1. Assume that {hi) is verified, and let Xq € H. Then (6.1) 
has a unique mild solution x € C([0, T]; H). 

Proof. It follows from Proposition 3.6 (Part II, Chapter 1, §3). □ 

We now prove a basic identity. 

Proposition 6.2. Assume that {hi) is verified, and let u € L 2 (0,T; U), xo G 
H. Let x be the mild solution of the state equation (1.1), and let P be the mild 
solution of Riccati equation (2.7). Then the following identity holds: 

J (u) = f \u(s) + B*P{T — s)x{s)\ 2 ds + (P{T)x 0 ,x 0 ). (6.2) 

Jo 

Proof. Let P n be the solution to (2.10), and let x n be the solution to the 
problem 

(x' n (t) = A n x n {t) + Bu(t), fe[0,T], 

|a;„(0) = x 0 G H, 

where the Gl n ’s are the Yosida approximations of A. We follow here a classical 
argument; see for instance R. W. Brockett [1]. By computing the derivative 

-^(P n {T - s)x n {s),x n {s )) 
and completing the squares, we obtain the identity 

-^-(P n {T-s)x n {s),x n {s)) = \u{s) + B*P n {T-s)x n {s)\ 2 - \Cx n {s)\ 2 - |u(s)| 2 . 

Integrating from 0 to T and letting n tend to infinity, we obtain (6.2). □ 

We are now ready to prove the following result. 

Theorem 6.1. Assume that {hi) is verified, and let xq G H. Then there exists 
a unique optimal pair ( u*,x *). Moreover the following statements hold: 

(i) x* G C{[0,T]; H) is the mild solution to the closed loop equation (6.1), 

(ii) u* G C([0, T]; U) is given by the feedback formula 

u*{t) = -B*P{T - t)x*(t), t G [0,T], (6.3) 

(iii) The optimal cost J{u*) is given by 

J(u*) = {P{T)x 0 ,xo). (6.4) 

Proof. We first remark that by identity (6.2) it follows that 

J{u)>(P{T)x 0 ,x q), (6.5) 

for any control u G L 2 (0, T; U). Let now x* be the mild solution to (6.1), and 
let u* be given by (6.3). Setting in (6.2) u = u* and taking into account (6.5), 
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it follows that (it*, a;*) is an optimal pair and that (6.4) holds. It remains to 
prove uniqueness. Let (u,x) be another optimal pair. Setting in (6.2), u = u 
and x = x. we obtain 


| u(s) + B*P(T — s)a;(s)| 2 ds = 0, 

so that u(s) = — B*P(T — s)x(s) for almost every s in [0,T], But this implies 
that x is a mild solution of (6.1) so that x = x* and, consequently, u = u*. □ 

6.2 The case of unbounded observation 

We now consider the case of unbounded observation, assuming that (W)-(i)- 
(ii)—(iii)—(v) are verified. It is convenient to introduce the linear operator: 

£ i—» L t (£) : D(A) —» L 2 (0, T ; H), 

where (LrO(t) = Ce tA (. As, by (H)-(v) 

Lt has an extension to the whole space H : which will still be denoted by Lt- 
Let Xq & H, u £ L 2 (0,T;U), and let x be the corresponding solution of 
(1.1). We want to define the cost functional J(u); this is not a priori defined 
because x(t) does not necessarily belong to D(C) and the term J Q T |Ca:(t)| 2 dt 
is not well defined. We set 

Cx(t) = (LTXo)(t) + f Lt(Bu(s)) (t — s) ds. 

J o 

This definition is meaningful in virtue of the following lemma. 

Lemma 6.1. Let z £ L 2 (0,T; H), and set 

w(t) = f LT(z(s)){t — s) ds. 

Jo 

Then w £ L 2 (0,T; H) and the following estimate holds: 

ll' u; lll 2 (0,T;H) ^ K(T)\\z\\ 2 L 2( 0 ,T\H)- 

Proof. It is sufficient to verify the estimate for 2 £ L 2 (0, T; D(A)); in this 
case we have 

w(t)= [ Ce {t ~ s)A z(s)ds. 

Jo 

Let ip £ L 2 (0, T; H); then we have 
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[ (w(t),ip(t)) dt = f ds f (Ce^ s ^ A z(s),ip(t)) dt. 
Jo Jo Js 


It follows that 


r T 


' r T 

1/2 

’ r T 

/ (w(t),¥>(t))dt 

Jo 

< / ds 

Jo 

/ \Ce^~ s)A z{s)\ 2 dt 

J S 


/ \m 2 dt 

J s 


— ll ( i 3 llL 2 (0,T ; tt) ll^ll L 2 ( 0 ,T ; tt)- 


As this is true for any ip, we obtain the estimate. □ 

Now the following result is proved as Theorem 6.1. 

Theorem 6.2. Assume that (7d)-(i)-(ii)-(iii)-(v) are verified, and let Xq € 
H. Then there exists a unique optimal pair ( u*,x *). Moreover the following 
statements hold: 


(i) x* £ C([0,T]; H) is the mild solution to the closed loop equation (6.1), 

(ii) u* € C([0,T];U) is given by the feedback formula (6.3), 

(iii) the optimal cost J(u*) is given by (6.4). 


6.3 Regularity properties of the optimal control 

We give here some regularity results for the optimal pair ( u*,x *). 

Proposition 6.3. Assume that {H) is verified. Let Pq £ D{A) and x £ D{A), 
where A is the linear operator defined by (3.3). Then 

x* £C 1 ([0,T}-H) nC([0,T]; D(A)), u* £ C7 1 ([0,T]; H). 

Proof. By Proposition 3.2 we know that the mild solution P to the Riccati 
equation (2.7) is a strict solution, so that 

P £ Cl([0,T}-,E(H)) nC s ([0,T]-,D(A)). 

Now the assertion concerning x* follows from Proposition 3.3 (Part II, Chap¬ 
ter 1). □ 

Proposition 6.4. Assume that (7 i) is verified and that e tA is an analytic 
semigroup. Then the following statements hold: 

(i) for any e £ ]0,T/2[, x * ( resp. u*) belongs to C°°(]£,T — e[ ;H) ( resp. 
C°°Qe,T-e[-,U)). 

(ii) it* and x* are analytic in ]0,T[. 

Proof, (i) We first remark that by (6.3) u* £ C([0, T]; U). Moreover, as (#*)' = 
Ax* + Bu* and a:*(0) = xo , we have, by Proposition 3.10 (Part II, Chapter 1), 
x* £ C a ([eT];H) (for any a £ ]0,1[) and e £ [0,T]. By (6.3) and Theorem 3.1 
we have u* £ C a ([s,T — s\;U). Then, by Proposition 3.9 (Part II, Chapter 1), 
x* belongs to C l ([e,T — e\;H). By iterating this argument the assertion (i) 
follows. Finally (ii) is a consequence of Theorem 3.2. □ 
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6.4 Hamiltonian systems 

Assume that (H) is verified, let P be the mild solution of (2.7), and let («*, x*) 
be an optimal pair. In (6.1) it is useful to introduce the following function: 

p*(t) = P(T-t)x*(t) 

called the adjoint variable. If we differentiate p*(t), assuming for a while that 
the conditions of Proposition 6.3 hold, we easily deduce from (2.7) and (6.1) 
that p*(t) satisfies the equations 


I -p'(t) = A*p{t) + C*Cx(t), 
\P(T) = P 0 x(T) 

and thus considering (6.6) together with 


x'(t) = Ax(t) — BB*p(t), 
x(0) = x 0 , 


( 6 . 6 ) 


(6.7) 


we obtain a system (the two point boundary value problem) whose solution is 
(x*,p*). The system (6.6)-(6.7) is called Hamiltonian system. Once we have 
established (6.6)-(6.7) for regular xq, Pq, it is easy to extend it to the general 
case. 

Remark 6.1. One can notice the analogy between (6.6)-(6.7) and (2.24), which 
was the source of the explicit formula (2.22) for P(t). □ 


7 Some generalizations and complements 

7.1 Nonhomogeneous state equation 

Consider the following optimal control problem: To minimize 

J(u)= l T {\Cx(t)\ 2 + \u(t)\ 2 }dt+{P 0 x(T),x(T)) (7.1) 

Jo 

over all controls u £ L 2 (0, T; U) subject to the differential equation constraint 

(x'{t) = Ax{t) + f(t) + Bu(t), I £ t). /’],. . 

(a;(0) = xo £ H. 

We assume that hypothesis (H) holds and that / £ L 2 (0,T; H). Moreover 
we denote by P the mild solution of the Riccati equation (2.7). We want to 
show that it is possible to generalize the Dynamic Programming approach to 
this more general situation. The main difference is the introduction of a dual 
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variable r, defined by the following backward Cauchy problem: For all t in 

M 

r r'it) + (A* - P(T - t)BB*)r(t) + P(T - f)/(t) = 0, 

|r(T) = 0. 

Notice that, by the change of variable t —> T — f, problem (7.3) reduces to an 
initial value problem, which has a unique mild solution. 

The following identity generalizes identity (6.2). 

Lemma 7.1. Let xo £ H, f £ L 2 (0,T; H), and u £ L 2 (0,T;U). Then we 
have 

J(u) = (P(T)xo, * 0 ) + 2(r(0), s 0 ) + f { 2 {r(s), f(s)) - \B*r(s)\ 2 } ds 

J 0 

+ / \u(s) +B*r(s) +B*P(T- s)x(s )\ 2 ds, 

Jo 

(7.4) 

where x and r are, respectively, the mild solutions of (7.2) and (7.3). 

Proof. Let P n be the solution of (2.10), and let x n and r n be the solutions of 
the problems 


I x' n (t) = A n x n {t) + /(f) + Bu(t), 

|a: n (0) = Xq, 

Ir'Jt ) = - (A* - P n (T - t)BB*)r n (t) - P n (T - t)/(t), 

\r n (T) = 0. 

Then, by integrating the identity 


-^{(P„(T-s)x n (s),x n (s)) + 2(r„(s),a; n (s))} 

= | B*P n (T-s)x n (s) + B*r n (s) + u(s)| 2 + 2(r„(s),/(s)) - \B*r n (s )\ 2 

- |Ca; n (s)| 2 - |tt(s)| 2 

between 0 and T and by letting n tend to infinity, we obtain (7.4). □ 

By using identity (7.4) we can easily generalize Theorem 6.1. The proof is 
similar and will be omitted. 

Theorem 7.1. Assume that ( H ) is verified, let Xo G H, and let f £ L 2 (0, T; H ) 
Then there exists a unique optimal pair ( u *, x*) for problem (7.1)-(7.2). More¬ 
over the following statements hold: 

(i) x* is the mild solution to the closed loop equation 


x'(t) = (A-BB*P(T-t))x{f)-BB*r{f) + f(t), t£ [0,T], x(0) = x 0 , 
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(ii) u* is given by the feedback formula 

u*(t ) = - B*[P(T - + r(t)], 

where r is the mild solution to (7.3), 

(iii) the optimal cost is given by 


j{u*) = (P(T)xo,xo) +2(r(0),ffo) + [ [(2 r(s),f(s)) - |5*r(»| 2 ] ds. 

Jo 

Remark 7.1. (Tracking Problem). Consider the following optimal control prob¬ 
lem: To minimize 

K{u) = J {\Cx(t) - £(f)| 2 + \u(t)\ 2 }dt, 

+ (P 0 (x(T) - £(T)), (x(T) - C(T))) (7.5) 

over all controls u £ L 2 (0, T; U) subject to the differential equation constraint 

(z'(t)=Az(t) + Bu(t), te[0,T], 

|z(0) = z 0 £ H. 

Here £ £ IV 1,2 ([0, T]\ H) CL 2 (0, T; D(A)) is a given function. Now, by setting 

x = z-£, f = Af - x 0 = z 0 -x(0), 

equation (7.6) reduces to equation (7.2) and problem (7.5)-(7.6) to problem 
(7.1)-(7.2). □ 


7.2 Time-dependent state equation and cost function 

Consider the system 

= A(t)x(t) +B(t)u(t), 

\z(0) = x 0 , 

where A(t): D(A(t)) C H —> H and B{t) £ C(U;H) are linear operators. 

We make the following assumptions on the families {T(f)} te [ 0 T i and 
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(i) Aft): D(A(t)) C H —> H generates a Co semigroup in H 
for all t £ [O.T], 

(ii) there exists a strongly continuous mapping 

{(t,s)£R 2 :t>s}^jO(H) 
such that U%(-, •) is also strongly continuous and 
d 

— U A (t, s)x = A(t)U A (t, s)x, U A (s, s)x = x, 

\/x £ D(A(t)), 0 < s < t < T, 

(iii) we have lim U An (t,s)x = U A (t, s)x,\/x £ H uniformly on 

n—>oo 

the bounded sets of {(t, s) £ R 2 : t > s}, where 

U An (t, s) is the evolution operator generated by the Yosida 

approximations of A(t), 

(iv) B(-)u is continuous for all u £ U. 


Under these assumptions problem (7.7) has a unique mild solution given by 

x(t) = U(t, 0)xo + f' U(t,s)Bu(s)ds. 

Jo 

Assumptions (7.8) are verified in many problems both parabolic and hy¬ 
perbolic (see for instance P. Acquistapace and B. Terreni [1], A. Lu- 
nardi [3], A. Pazy [2], and H. Tanabe [1]). 

We want to minimize the cost function 

J(u)= f { |C(s)a;(s)| 2 + |w(s)| 2 } ds + (Pqx(T), x(T)) 

Jo 

over all controls u £ L 2 ( 0, T; U) subject to the differential equation constraint 
(7.7). Concerning the operators B, C, and Pq, we shall assume that 


P 0 £S+(H ), C£C s ([0,T)-,jC(H-,Y)), 

B£C s ([0,T]-,C(U-,H)). 

It is convenient to consider the backward Riccati equation 

(Q' + A*Q + QA- QBB*Q + C*C = 0, 
\Q(T) = P 0 . 

Its corresponding mild form is 


Q(t)x = U*{T,t)P 0 U{T,t)x + J U*(s, t)C*(s)C(s)U(s, t)xds 


U*(s,t)Q(s)B(s)B*(s)Q(s)U(s,t)xds, x £ H, 
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where U*(s,t) is the adjoint of U(s,t). 

The following theorem is proved as Theorem 2.1. 

Theorem 7.2. Assume (7.8) and (7.9). Then problem (7.10) has a unique 
mild solution Q £ ^([O, oo[; E + (H)) and 

lim Q n = Q in C s ([0,oo[; E(H)), 

n—> oo 

for any T > 0, where Q n is the solution to problem (7.10) with Aft) replaced 
by A n (t). 

The following monotonicity property of the solutions of Riccati equations 
is proved as Proposition 2.2. 

Proposition 7.1. Consider the Riccati equations 

f Q'i + A*Qi + QiAi — QiBiBfQi + C*Ci = 0, 

\Qi(T)=Qi, o, / - 1.2. 

Assume that (Ai, B{, Ci, Pip) verify (7.8) and (7.9) fori = 1,2 and that, in 
addition, 

Pi,o < P 2 . 0 , 

CUt)Ci(t)<C*(t)C 2 (t), B 2 (t)BUt) < B l {t)Bl{t), t G [0,T], 

Then we have 

Pi{t)<P 2 (t), t> 0. (7.12) 

By using Theorem 7.2, we can easily generalize Theorem 6.1. 

Theorem 7.3. Assume (7.8) and (7.9), and let Xq £ H. Then there exists 
a unique optimal pair (u*,x*) and u* £ C([0,T];U) is related to x* by the 
feedback formula 


u*(t) = —B*(t)Q(t)x*(t), t £ [0, T]. 

Finally,the optimal cost J(u*) is given by 

J(u*) = (Q(0)x 0 ,x o ). 

Remark 7.2. For the time-varying variational case the reader is referred to the 
book of J. L. Lions [3]. □ 

7.3 Dual Riccati equation 

We assume here that (fH) is verified and consider the Riccati equation 


P' = A*P + PA- PBB*P + C*C, t> 0, 
^(0) = Po 


(7.13) 
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and the dual equation 

(Q' = AQ + QA* - QC*CQ + BB*, t > 0, 

\Q(0) = Qo, 

where Qq £ E + (H). Clearly the set (A*,C*, B*,Q 0 ) also verifies assump¬ 
tion ( H ); thus the equations (7.13) and (7.14) have unique solutions P,Q £ 
C s ([0, +oo[; S + (H)), respectively. 

We want to present here a simple formula that gives P in terms of Q. This 
formula will turn out to be useful in Chapter 3 below, and it was proved in 
V. Barbu and G. Da Prato [1], by variational methods. 

Fix T > 0, and set 


Qt{s) = Q(T-s), s £ [0,T], (7.15) 

and 

G T (a)=A*-C*CQ(T-a), s £ [0, T]; (7.16) 

we shall denote by Ug t the evolution operator associated with Gt- 
We first prove a lemma. 

Lemma 7.2. Fix T > 0, and set 

Z T (t) = [I + PWQrW-'Pit) = P(t)[I + Q T (t)P(t)}- 1 . 

Then for any x £ H we have 

Z T {t)x = U GT (t,0)Z T (0)U^ T (t,0)x+ f U GT (t,s)C*CU^ T (t,s)xds. (7.17) 

Jo 

Proof. We assume that A is bounded; otherwise we replace A by its Yosida 
approximations A n and then we let n tend to infinity. We first remark that 
the definition of Zt is meaningful by Proposition 1.1 in Appendix A. Setting 
for simplicity Z = Zt and Q = Qt we have 

(.I + PQ)Z = P 

and so 

{P'Q + PQ')Z + (/ + PQ)Z' = P\ 

which implies 

{I + PQ)Z' = P' - {P'Q + PQ')\I + PQ]^P 
= P' - (P'Q + PQ')P[I + QP p 1 
= [P'(I + QP)-(P'Q + PQ')P][I + QP]- 1 
= [P' - PQ'P][I + QP}- 1 . 
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It follows that 

(/ + PQ)Z'[I + QP] = P' - PQ'P. 

Then, by substituting P' and Q' with the expressions given by (7.13) and 
(7.14), we have 

[I + PQ\Z'[I + QP] = A*P + PA- PBB*P + C*C 

+ P[AQ + QA* - QC* CQ + BB*]P 
= [I + PQ](A* - C*CQ)P + P(A - QC*C)[I + QP] 

+ [I + PQ]C*C[I + QP]. 

Therefore 

Z' = {A* - C*CQ)Z + Z(A - QC*C) + C*C, 
and the conclusion follows. □ 

Theorem 7.4. Assume that (Tt) is verified, and let P and Q be the respective 
solutions in C s ([0, +oo[; S + (H)) of (7.13) and (7.14) with Qo = 0. Let T > 0 
and set 

G T (t) = A* - C*CQ T {t) = A* - C*CQ(T - t), ie [0,T], 

Then we have 


P(T) = Ug t (T, 0)[/ + PoQ(T)]~ l P qUq t (T, 0) 

+ [ U GT {T,s)C*CU* GT {T,s)ds. (7.18) 
Jo 


Proof. As 


Z T ( 0) = [I + PqQ(T)]~ 1 P 0 


and Zt(T) = P(T ), the conclusion follows from (7.17). 


□ 


8 Examples of controlled systems 

8.1 Parabolic equations 

Let fl be an open bounded set of R n with regular boundary 90. Consider the 
state equation 

-gf&O = ( A i+ c )x(t,0 + (Bu(t, ■))(£), in ]0,T] x O, 
x{t,£) = 0 on]0,T]x9O, 
x(0,£)=x 0 (£) in O, 


( 8 . 1 ) 
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where cel and B G C(L 2 (tt)). We choose H = U = Y = L 2 (tt) as space 
of states, controls, and observations. The control u is said to be a distributed 
control. We denote by A the linear self-adjoint operator in H: 

j Ax = Acx + cx, \/x £ D(A), 

= H 2 (n)nH%(n). 

Setting x(t) = x(t, ■),u(t ) = u(t, •) we can write problem (8.1) in the abstract 
form (1.1). By Proposition 2.11 (Part II, Chapter 1), A is the infinitesimal 
generator of an analytic semigroup in H. Let C and Pq be non-negative linear 
bounded operators in L 2 ( fi). Consider the following problem: To minimize 

J(n) = [ T [ {\{Cx(t,-))(0\ 2 + Ht,0\ 2 }dtd£+ [ (P 0 *(T,-)(0*(r,OK 
Jo Jn Jn 

subject to state equation (8.1). We remark that assumption (Tt) is fulfilled. 
Due to Theorem 2.1, the Riccati equation (2.7) has a unique solution P £ 
C s ([0,T]; S + (H)). Then, by Theorem 6.1, there exists a unique optimal pair 
(■ u*,x *), where x* G C([0, T\; L 2 (tt)) is the classical solution in ]0,T[ to the 
closed loop equation 

' f) r r‘ 

— (t,0 = (A i+ c)x(t,0 - (BB*(P(T-t)x(t,-))(0, 

< in ]0, T] x fl, 
x(t,£) = 0 on ]0,T] x dfl, 
x(0,£)=x o (O in 


that is, 

Ve e ]0, T[, — and — G L 2 ([e, T - e] x SI). 

Moreover u * is given by the formula 

u*(t,t) = -(B*(P(T-t)x*(t,■)){$)■ 


Consider now a problem with unbounded observation: To minimize 

j(u)= [ T [ +Mt,o\ 2 }dtdt+ 

Jo Jn 

subject to state equation (8.1). In this case the linear operator C is given by 


[ \x(T,Z)\ 2 dt 
Jn 


Cx = — \J A^x, 


and Proposition 4.2 can be applied. 
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8.2 Wave equation 

Let O be as in the previous example and consider the problem: 


-gp (*>0 = ^*(*>0 + in ] 0 , T] x n , 

x (t,£) = 0 on ]0, T] x 90, 

*(0,0 = *o(0> in f2, 
ljr(°,0 = *i(0 in n. 


H = Y = H^(Cl)®L 2 (Cl), U = L 2 (n) (8.3) 

and denote by X = , the generic element of H. The inner product in H 

is defined by 

( fi , i ) = JjVtx 0 ■ V s z° + zV) d£. (8.4) 

Let A be the self-adjoint positive operator on L 2 (fl) defined by 


Then we have 


D(A) = H 2 (Q) n Ax = -A^x. 


(X,Z) = (VAx°,VAz°) + (x 1 ,z 1 ). 


Define the linear operator A on H: 


AX = 


0 1 x 1 


i , VXeD(A), 


{d(a ) = H 2 {rt) n Hl{n) © h£(Q). 

We have A* = —A and by Proposition 2.12 (Part II, Chapter 1) we know 
that A is the infinitesimal generator of a contraction group in H. Let finally 
B G C(U ; H) be defined as 


Bu = , u £ U: 

u 


then B* € £(H, U) is given by 


f>* X _ _1 X c TT 

B „1 — * , _i G -n. 


and we have 


0] mol fx' 


cc 1 “ hr 1 “ 0 1 hr 1 • 
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Setting 


x°(t) = x 1 ^) = — (t, ■), u(t) = 


we can write (8.2) in the abstract form 

Y' = AY + Bu, y ( 0 ) = y 0 , 

where 


(8.7) 


Y(t) = 


x°(t) 


Yn = 


’ 0 

We are interested in the following optimal control problem: To minimize 


J{u)= JoL ( |v ^’° |2+ 


dx, 


i(i,OI 2 ) dtd£ 


+ 


|V^(T,OI 


2 , I to, e) 
dt [ 


dC, (8-8) 


over all u G P 2 ([0, oo] x fl) subject to (8.2). The cost function J{u) can be 
written as 

J(u) = f T {\Y(t)\ 2 H + \u(t)\l}dt+\Y(T)\%. 

J o 

The Riccati equation is 


P' = 


0 -1 
A 0 


0 1 
-A 0 


P + P 

P( 0) = 


- P 


0 0 
0 1 


p 


1 0 
0 1 


1 0 
0 1 


We can represent P as 


P = 


Pi 1 Pl2 

P-21 P‘22 


where 

p n g Pi 2 g c(L 2 (ny,H^(n)), 

P21 g c(H^(ny,L 2 (n)), p 22 g c(L 2 {n)), 

and the following identities hold: 

i ~ 1 D* - /ID- p* — Poo 
•* 22 — r 22 . 


P*, =AP U A~\ 


P\2 = PnA-y P^=AP 12 , 


Setting C = I, we can apply Theorem 2.1 and conclude that the Riccati 
equation has a unique mild solution P G C s ([0, 00 [ -,E + (H)). Moreover by 
Theorem 6.1, there exists a unique optimal pair (u*,x*) and 

= -(P 2 l(T - ■))(£) - (p 2 2(T - •)) (0- 
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The closed loop equation is 
d 2 x 

w (t,Z)=Atx(t,t)~ (P 21 (T — t)x(t, •)) (£) 

-(p 2 2(T-t)^(t,-))(0 m)0,T[xQ, 
x{t,£) = 0 on]0,T[x 
*(0,0 = *o(0> 

^(*>0=* i(0 mn. 


Remark 8.1. Similar results can be obtained if one replaces in problem (8.2) 
the Dirichlet by the Neumann boundary condition. 

^AO = A -x{t,0 + (Bu(i,-))(0 in ]0,T] x ft, 

dx 

(1,0=0 on]0,T]xan, ( 8 . 9 ) 

*(0,0 = *o(0 infi, 

^(O,0 = *i(0 inn, 

where v is the outward normal to dtt. In this case we set 

H = Y = L 2 (fl), U = L 2 {fl), (8.10) 

and define the scalar product in H by 

+ [ x°z°d 0 (8.11) 

J fi 

Moreover we define a self-adjoint positive operator A\ on L 2 ( n ) by 



D{A\) = lx £ H 2 ( n) : —— = 0 on dfl 0 
1 dv 


k A\x = —A^x, 
and the linear operator A\ on H: 

AiX = 


T—1 

o 

1_ 


1 

o 

_1 

1- 

. 

, O 


1 

_1 


, VXeD(A), 

D(A 1 ) = \x£H 2 (VL):^-=Q on 9n| ©^(n). 


( 8 . 12 ) 


(8.13) 


□ 


Now all previous considerations can be easily generalized. 
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8.3 Delay equations 

We start with a simple example given in §2.10 (Part II, Chapter 1). A more 
elaborate treatment of differential delay systems with delays in the control 
and observation variables will be given after using the general state space 
frameworks developed in Chapter 4 of Part II. 

Let D, E £ £(C n ), r > 0, and consider the problem: 

{ . z'(t ) = Dz(t) + Ez(t — r) + u(t), t> 0, 
z(0) = h 0 £ C\ (8.14) 

z(9) = hi(0), a.e. 9 £ [—r,0], 

where hi £ L 2 (—r , 0; C") and u £ L 2 ( 0, T ; C n ). We shall use here the notation 
of §2.10 (Chapter 1 in Part II). We set 

H = L 2 {-r, 0;C n ), U = C n , x(t) = (z(t), z t ). 

Then problem (8.14) is eciuivalent to 

x' = Ax + Bu, x(0) = (ho, hi), 

where A is defined by (2.104) in Chapter 1 of Part II and B is the linear 
operator 

u i—► Bu = (u, 0): C" —> H. 

We remark that the adjoint operator B * is given by 

(a.’o, %i) e-> B*(x o, Xi) = xo: H —> C™. 

Consider now the problem: To minimize 

J(u)= f T {\z(t)\ 2 + \u(t)\ 2 } dt + \z(T)\ 2 
J 0 

over all u G L 2 (0,T;C n ) subject to (8.14). J(u) can be written as 

J(u) = j\\Cx(t)\ 2 + \u(t)\ 2 } dt + (P 0 z(T),z(T)) cnxL2{ _ rfi , cny 


where 

C(x 0 ,xi) = (x 0 ,0) and P 0 (xo, x{) = (x 0 , 0). 
The Riccati equation is 

P' = A*P + PA-P 2 + C*C, P(0) = P 0 , 

because, as easily seen, BB* = [J§], 

We can write P as 
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where 


Poi Poi 
P10P11 ’ 


Poo G £(€"), Poi G £((L 2 (0,T;C n );C")), 

P 10 G £(<C"; (P 2 (0,T;C n )),P n G £(L 2 (0,T; C")). 

Then the optimal control is given by 

u*(t) = -P 00 (T - t)z*(t) - P 0 i(T - i)a*. 


We now consider the more general situation. The abstract theory devel¬ 
oped in Chapter 4 of Part II (Theorem 4.1) for unbounded observation oper¬ 
ators applies to a class of delay systems with delayed observations where the 
control operator of the state equation is bounded. Following the notation and 
definitions of §5 (Chapter 4, Part II), a delay differential system with controls 
and observations is given by 

x(t) = Lxt + But, t > 0, 

(a:(0), xo, uo) = (^°,^ 1 ,w) G M 2 x L 2 (-h, 0;R m ), 
y{t) = Cx t , t> 0. 


(8.15) 

(8.16) 


The spaces of controls and observation are U = R m and Y = , respectively. 

By introducing the extended structural state x(t) in H = M 2 x L 2 (—h,0'Y) 
(cf. Part II, Chapter 4, §6.2, Theorem 6.1, equations (6.11) to (6.14)), system 
(8.15)-(8.16) can be transformed in the form 


*x{t) = ( A T )*x(t ) + ( B T )*u(t ), t > 0, 
®( 0 ) = 


(8.17) 


where P T : D(A T ) —> U and C: P((A T )*) —> Y are continuous linear maps 
when the domains are endowed with their respective graph norm topologies. 
The operator B T is bounded and continuous on H when it is of the form 

,° 

B T {ip 0 ,^ 1 ,v) =Bjip°+ / Bj(e)ip 1 (6)de (8.18) 

J-h 

for some matrices Bq and B i(&), 9 G I(—h, 0), such that the elements of B i(-) 
belong to i 2 (— h, 0). Then 

(B T )*u= (Bot^BiO,*)). (8-19) 

So we specialize to systems (8.15) of the form 
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( 8 . 20 ) 


x(t) = Lx t + B 0 u(t) + j Bi(9)ip 1 (9)u(t + 9) d6, t > 0, 

J-h 

{x(0),Xq,Uq) = 

The operator C is of the general form (cf. Part II, Chapter 4, §6.2.2) 

$ = (¥>0,+ C, Ctp 1 + A) ^ = C<P! + A(0): H((A T )*) -> Y, (8.21) 

where A) is a representation of the elements of Z?((A T )*). 

So we only need to check part (ii) of condition (H)-(v) 

f \Ce s ^e Y ds < K(tm 2 H, e D((A T r). 

Jo 

In the notation of Part II, Chapter 4, ) is ( S T )*(t ) and 

C{S T )*(t)Z = Cx(t ) = Cx t + [r(t)A] (0) 

= (Ce° + x)(t) + (e+ h e)(-t), 

which is continuous as an element of L 2 (0,T;F) with respect to £ and 

-+ 


(e.' l £ 2 )(—t) is the shift of an L 2 -function. This holds for each finite T > 0. 


As a result we have the following proposition. 

Proposition 8.1. When the mapping B is of the form (8.18), the Riccati 
equation 

(p' = a t p + p(A T y - p(b t )*b t p + c*c, 
lP(0) = P o , 


( 8 . 22 ) 


has a unique mild solution P in C s ([0, oo [;A7 + (If)), where H = M 2 x 
L 2 {—h, 0; Y). 

The Riccati equation (8.22) on [0, T], T > 0, is associated with the mini¬ 
mization of the cost function 

J(u) = f [\Cx t \ 2 + \u{t)\ 2 ]dt + Fx{T)-x(T) (8.23) 

J o 

over all u in i 2 (0, T; F), where 


p 0 (e,e,n = (*r,o,o), v? = (e,e,n- 


The optimal control u* can be expressed in feedback form 
u*(t) = -B t P(T- t)x{t), t> 0, 
where for the initial conditions in (8.15) 

x(t) = (x(t),Lx t +Bu* t ,Cx t ). 
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As P(t) can be decomposed into a 3 x 3 matrix of operators on the state space 
H = r x L 2 (-M,r) x L 2 (-h,0,Y) 

Poo(t) Poi{t) Po2{t) 

P(t)= P W (t) Pll(t) Pl2 (t) , 

P20(t) P2l(t) P22{t)_ 

and B t has the special form (8.18) 

B T P(T-t)x(t)=Bj{P 00 (T-t)x(t)+P 01 (T-t)x(t)[Lx t +Bu*} 

+P 02 (T-t)Cx t } + / Bj(9){P W (T - t)x(t) 

J-h 

+ P n (T - t)x(t)[Lx t + Bu* t } + P l2 (T - t)Cx t }{9) dd. 

It is important to notice that the feedback is through the structural operators 
L, B , and C on Xt and This state captures the minimal information 
necessary for the feedback synthesis. Without this notion of state, determining 
directly expressions as above is almost hopeless in the general case. We leave 
it to the reader to specify L, B and C in special cases! 

The same problem can also be formulated by using the extended state x(t) 
in H = M 2 x L 2 (—h, 0; U) (cf. Part II, Chapter 4, §§5.2 and 6.1, eqs. (6.7) to 
(6.10)) which verifies the state equation 

1 ±rm = arm + arm, (S24) 

\i(0) = (pOp^w), 

with the observation eciuation 

y(t) = Cx(t) (8.25) 

(cf. Chapter 4, §6, equations (6.7) and (6.8)), where B T : D(A*) —> U and 
C: D{A ) —» Y are continuous linear maps when the domains are endowed 
with their respective graph norm topologies. When the control operator is 
given as in (8.20), the operator B T is equal to 

r° 

B t (^) = B^(0)+ Bj (0)ip(9) d9 + A(0), (8.26) 

J-h 

where ip, £, A is a representation of an arbitrary element £ of D(A*) 

Z = (iP(o),L T ip + (,B T ip + \). 

The operator B T is unfortunately not bounded on H. As for C it takes the 
simple form 


C(<p(Q ),<p,w) = Cip, 


(8.27) 
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and part (ii) of condition (H)-(v) 

f \Ce sA e Y ds < K(tm 2 H , V? G D{A), 

Jo 

is verified. In the notation of Part II, Chapter 4, e tA is S(t) and 

CS(t)£ = C(x(t),x t , ( e°_w) t ) = ( Cx)(t ), 

which is continuous as an element of L 2 (0,T;Y) with respect to £ in M 2 x 
L 2 (0,T;77). However B T is not bounded on H because it contains a delta 
function. So we cannot use the general theory of §4. 

However we have seen in §6.3 of Chapter 4 in Part II that x and x are 
intertwined via the structural operator 

7 0 O' 

0 I B 0 (8.28) 

0 C Hi 



(cf. (6.74) and (6.77) to (6.80) in Theorem 6.2). Then for the optimal control 

it* 

x(t\F(<t>°,(f l ,w),u*) = Fx(t; {(j)°,(jA ,w),u*). 

So it is not too difficult to guess that for the formulation (8.23)-(8.24)-(8.25), 
there will be a Riccati equation and a solution 77(f) related to P(t) through 
the identity 

77(f) = F T P(t)F. 

To see that, multiply the Riccati equation (8.22) by F T on the left and F on 
the right and use the intertwining identities 

CF = C, B t F t = B t , F t A t =A*F t , A t *F = FA 

(cf. Part II, Chapter 4, (6.79), (6.80) and from (6.78)) to obtain 


n' = A*n + nA - n{B T )*B T n + c*c, 
77(0) = F t P 0 F. 


(8.29) 


It corresponds to the control of an infinite dimensional system with both 
unbounded control and observation operators. We know what the Riccati 
equation associated with the state x{t) will look like, but it remains to give 
a precise meaning to such an equation and establish the properties of its 
solution. The necessary techniques that would allow us to do it are different 
than the ones that will be developed in the next two chapters. 

The last equation is associated with the same problem (8.23) with 

n 0 {?,e,e) = (Fe, o,o), v? =(£°,£\a- 


(8.30) 
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The optimal control u* can be expressed in feedback form 
u*{t) = -B t II(T- t)x(t), t> 0, 
where for the initial conditions in (8.15) 

x(t) = (; x(t),x t ,u t ). 

However in view of (8.26) the interpretation of B T 77 (T — t) is not clear unless 
some additional properties of 77 (t) are obtained. In that respect the extended 
state is simpler to define but because it does not incorporate the delay struc¬ 
ture of the problem, the feedback law is difficult to explicit. For a simple ex¬ 
ample of this property, the reader is referred to M. C. Delfour, E. B. Lee, 
and A. Manitius [1] and M. C. Delfour [15]. For a more detailed bibliog¬ 
raphy on the control of delay systems, the reader is referred to the references 
in Chapter 4 of Part II. Although the general case with delays in control and 
observation has a unique solution, it was not possible here to detail all special 
cases and the history of the problems 


8.4 Evolution equations in noncylindrical domains 

Consider the state equation 

! dx 

—(t,0 = Ax{t,0 + u(t,^), t e ]o,T], (en t , 

x(t,0 = o, te]o,T\, £edn t , ( 8 - 31 ) 

z(0,0 = a;o(£), £ G ^o, 

where for any t £ [0, T], fit is a bounded set in R" with a regular boundary 
d fl t . 

We want to minimize the cost 

J(u)= f T dt [ {|z(t,0| 2 + ML0| 2 M+ [ \<T,0\ 2 dt (8.32) 

J 0 J Ot J 

over all controls u € 7 2 ([0,T] x fl t ) subject to state equation (8.31). By 
7 2 ([0, T\ x fl t ) we mean the set of all functions u 


{t, 0 > u(t, 5): {(t, 0 ■ t £ [0,T],£ £ fl t } —> R, 
such that 1 1 — > \u(t, ^)| 2 dt; is measurable and 

f dt f \u(t, ^)| 2 dt; < + 00 . 

J o Jn t 

We first reduce problem (8.31) to an evolution equation in a cylindrical do¬ 
main, following G. Da Prato and J. P. Zolesio [1]. To this end we intro¬ 
duce, as in J. P. Zolesio [1], a suitable change of variables: 
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x(t,Q = z(t,T t (£)), u(t,£) = v(t,T t (£)), 

where T t is a regular mapping such that 

T t {n o)=n t , t g [0,T], 

Then problem (8.31) reduces to 

'*t = J t _1 div [Jt{(DT t )- 1 Y(DT t )- 1 Vz\ 

A +{(DT t )-iyx7z-±T t + v, te [0,T], (eSl 0 , (8 33) 

z(t,0 = 0 , t g [o,T], 

*z(0,£) = ao(£), £ G ^o, 

where J t is the determinant of the Jacobian matrix DT t of T t . 

We set H = U = L 2 (flo), z(t,-) = z(t), v(t,-) = v(t) and write (8.33) as 
an abstract evolution equation in H 

z'(t) = A{t)z(t) + v(t), 2 ( 0 ) = Xo, 

where A(t) is defined by 

\ A(t)w = J," 1 div [Jt((JJT))- 1 )*(iJT t )~ 1 Vui] + ((DTt^yVw ■ jT u 


[D(A(t))=H 2 (il 0 )nHyn 0 ). 

A(t) is the realization of an elliptic operator under Dirichlet boundary condi¬ 
tions, and consequently it is the infinitesimal generator of an analytic semi¬ 
group in H. Moreover we have A G C 1 ([0, T}\ C(D; H)) so that by H. Tan- 
ABE [1], assumptions (7.8) hold. The cost function (8.32) becomes 

J{v) =[ T dt[ J t (T- 1 (x))(\z(t,Z)\ 2 + \v(t,0\ 2 )dZ+ f \z(T,0\ 2 d !£, 

JO J Q 0 J Qq 

and we can study the problem as in §7.2. 

Remark 8.2. It is also possible to study problem (8.31) without changing vari¬ 
ables. By proceeding as in P. Cannarsa, G. Da Prato, and J. P. Zolesio 
[1], we assume that there exists a bounded open set D that contains all sets 
fit, t, € [0,T], and introduce unbounded operators {A(t)}, t € [0,T] with 
domain depending on time, but in the fixed space H = Lr(D) 

(D(A(t)) = {y€ L 2 (D) :y\ Qt € H 2 {kl t ), G H 2 (D\n t ), 

< y — 0 on dD, y = 0 on 

[a(£)u = Au,\/u G D(A(t)). 

Then we write problem (8.31) in the abstract form (7.7) and prove that (7.8) 
hold. □ 

Remark 8.3. An optimal control problem for the wave equation in moving 
domain has been studied with similar techniques in G. Da Prato and 
J. P. Zolesio [2], □ 




2 


Unbounded Control Operators: Parabolic 
Equations With Control on the Boundary 


1 Introduction 

As in the previous chapter, we shall denote by H : U, and Y the Hilbert spaces 
of states, controls, and observations, respectively. We consider a dynamical 
system, whose state x(t) is subject to the following equation: 

x'(t) = Ax(t) + Bu(t), x(0) = xo £ H, 

where u £ L 2 (0,T;U) and A: D{A) C H —> H generates an analytic semi¬ 
group in H. However, in the current case, the linear operator B is not supposed 
to be bounded from U into H. This situation has been discussed at length in 
Chapters 1 and 2 (Part II). However some key constructions will be repeated 
here as needed. In that case many possibilities could be considered. However, 
in practice, it will be natural to consider situations where B maps U into the 
dual space ( D{A *)) of D{A*). This will be apparent in the following Exam¬ 
ples 1.1 and 1.2. Equivalently, B is supposed to be of the form B = (Ao — A)D, 
where D £ C{U\H) and Ao is an element in p(A). Under these assumptions 
we write the state equation as 

x'(t) = Ax(t) + (Ao — A)Du(t), x(0) = xo, 
or in the mild form as 

x(t) = e tA x 0 + (A 0 -A) f e {t ~ s)A Du{s) ds. (1.1) 

Jo 

Remark that formula (1.1) is meaningful and x £ L 2 (0,T; H); see Chapters 1 
to 3 of Part II. This formula will represent the state of our system. 

The above representation of the operator B is also discussed in Chapter 2 
of Part II. The differential equation for the state still makes sense for a control 
operator B £ £(U\D(A*)'), and a representation formula can be obtained for 
x(t) (cf. Theorem 1.1 in Chapter 3 of Part II). These results can be sharpened 
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when A is the generator of an analytic semigroup (cf. Theorems 2.2 and 2.3 
in Chapter 3 of Part II) and the natural operator B € C(U, D(A*)') is D = 
[A 0 — A]~ 1 B through formula (1.1). 

We shall assume that 

! (i) A generates an analytic semigroup e tA of type ujq 

and Ao is a real number in p(A) such that to o < Ao, 

(ii) 3ct G ]0,1[ such that D G C(U, D(A a )) : 

where D(A a ) = £>([Ao — A]“) is the domain of the fractional power [Ao — A\ a 
of the operator Ao — A , as defined in §5 of Chapter 1 in Part II. For more 
details on the above techniques, the reader is referred to Chapter 1 (Part II). 
Assumption (TiV)i is equivalent to say that 

B = [Ao - A]D = [Ao - A] 1_a [A 0 - A] a D (1.2) 

belongs to C(U, .D((A*) 1_Q ) , ). In the variational case 

D((A*) 1 ~ a )=[D(A*),H] a =► B e C(U,[D(A*),H]' a ) 

and the regularity results of Theorem 2.2 (Part II, Chapter 3) would apply: 

VuGL 2 (0,T;[/)andVa;(0)G [[D(A),H] a ,[D(A*),H] , 1 _ a ] 1/2 
=► x G W([0,T-, [D(A),H] a , [D(A*),H]' 1 _ a ]). 

Remark 1.1. Assume that (HV)\ is verihed, and let x be defined by (1.1). By 
the Closed Graph Theorem, [Ao — A] a D is a bounded operator. Moreover, 
because 


(A 0 - A)e^- s)A Du{s) = [A 0 - A} 1 ~ a e^- s)A [ A 0 - A} a Du(s), 
there exists a constant k a > 0 such that 

|(A 0 — A)e^~ s ^ A Du(s)\ < k a (t — s) a-1 |u(s)| : , sG [0,f]. 


Thus the state x(-) can also be written as 

x(t) = e tA xo + [ (Ao — A)e ( - t ~ s ' >A Du(s) ds, 

Jo 

and the following estimate holds: 

|x(t)| < \e tA x 0 \+k a f \t - s)“^ 1 [i((s)| ds. 

Jo 

If a > from the Holder estimate, it follows that x G L°°(0,T] H); this 
implies that x G C([0,T}; H) by a standard density argument. In fact setting 
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Xk(t) = e tA x o+ f (Ao — A)e^ s ^ A kR(k, A)Du(s) ds, 

Jo 

we clearly have Xk G C([0, T]; P) and it is easy to check that Xk{t) —> x(t) 
uniformly in t. 

If a < 1/2, then x C([0,T];P) in general; however, arguing as before, 
we can easily check that [Ao — A] _/3 ai € C([0,T\; H) for all /3 > 1/2 — a. In 
the sequel, we shall discuss separately the cases a > 1/2 and a < 1/2; as we 
shall see, the second case is much more difficult to deal with. □ 

Consider the following optimal control problem: To minimize the cost func¬ 
tion 

J(u)= I {\Cx(t)\ 2 + \u(t)\ 2 }dt+(P 0 x(T),x(T)), (1.4) 

Jo 

over all u G L 2 (0,T;U), subject to the differential equation constraint (1.1). 
We assume, besides 

' (i) that C G C{H- Y),P 0 G E + (H), 

(ii) and that if a < 1/2 there exists (3 G [1/2 — a, (1 — a)/2] 
{HV )2 s 110 ! 1 that the following holds 

a? G D([ Ao - A\P) =► P 0 [Ao - Afx G Z?([A 0 - Al*]^ 3 ), 

, and [Ao — At*]^P 0 [Ao — Al] /3 is bounded. 

If assumption (HV )2 holds, we shall use the notation 

P /3 = closure [Ao — ^4*]^Po[Ao — Af, 

so that P (3 G E + (H) and 

P 0 = [Ao-^T^[Ao-A]-^. 

We remark that if a > 1/2, then we do not require additional conditions 
on P 0 , except that Po G £ + (H), whereas if a < 1/2, we need the assumption 
(7YP)2-(h) to make sense of the term 

(P 0 x(T),x(T)) = (Pp [A 0 - A]-f>x(T), [A 0 - A]~^x(T)), 

in the cost functional. In fact, if (3 > 1/2 — a, then [Ao — A\~^x G C([0, T]\H) 
(see Remark 2.1), and the trace value [Ao — A\~ , 3 X (T) is meaningful. 

By Assumption (TiV) we mean the set of assumptions (HV) i and (HV) 2 - 
We shall also say that (A,D,C,Po) fulfill {HP). The definitions of optimal 
control, optimal state, and optimal pair are as given in Chapter 1. 

We shall study the optimization problem (1.1)—(1.4), by using Dynamic 
Programming and by proceeding into the usual two steps. 
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First step. 


We consider the Riccati equation that formally reads as follows: 

l> = A *P + PA- P(A 0 - A)D(( A 0 - A)D)*P + C*C, 

\P(0) = P 0 . 

We set 

E=[\ 0 -A] a D, V = [A 0 - 

Then E £ C(U;H) by virtue of assumption (HV)i-(n) . Thus the meaningless 
term P(Ao — A)D((\o — A)D)*P can be written as V*EE*V and the Riccati 
equation rewritten as follows: 


I P' = A*P + PA- V*EE*V + C*C, 
\P(0) = P o , 

or in the integral form 


( 1 . 6 ) 


P(t)x = e tA * P 0 e tA x + f e^- s)At C*Ce {t ~ s)A xds 

Jo 

e {t - a)At V *{s)EE*V{s)e (t - s)A xds, x £ H. (1.7) 

We look for a solution P(-) of (1.7) such that V(t) £ C{H) for all t > 0. 
Second step. 

We shall show that the optimal control u* is related to the optimal state y* 
by the feedback formula 

u*{t) = -£>*(A 0 - A*)P{T - t)x*(t) = —E*V(T - t)x*(t). (1.8) 

Moreover x*(t) is the solution of the closed loop equation 

x(t) = e tA x 0 + [ [A 0 — A] 1 -°‘e {t - s)A EE*V(T - s)x(s) ds, (1.9) 
Jo 

which can be solved by a fixed point argument. 

We now give some bibliographical comments. Early papers treating bound¬ 
ary control problems are due to A. V. Balakrishnan [4, 5] and D. C. Wash¬ 
burn [1], who developed further an old idea in H. O. Fattorini [3]. Sim¬ 
plifications and refinements through domains of fractional powers were intro¬ 
duced in R. Triggiani [3]. Another approach is due to A. CHOJNOWSKA- 
Michalik [1] and J. Zabczyk [4] (see also Chapter 3 in Part II for an al¬ 
ternate interpretation of their constructions). The Riccati equation (1.7) was 
first studied by A. V. Balakrishnan [5] when Pq = 0 and by I. Lasiecka 
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and R. Triggiani [3] when P$ is a positive multiple of the identity. They 
were able to build an explicit solution of the Riccati equation by generalizing 
the representation formula (2.22) of Chapter 1; we remark, however, that this 
method does not give uniqueness. A direct approach to solve (1.7) was first 
used by F. Flandoli [1] under the assumption that Vo = [Ao — A*] 1 ~ a P 0 is 
bounded; he showed that, in this case, there exists a unique solution P(t) such 
that [A 0 — A*Y~ a P{t) is bounded for any t. Moreover the closed loop (1.9) can 
be solved directly and the feedback formula (1.8) holds true. The same direct 
approach was used by G. Da Prato and A. Ichikawa [1], which proved that 
(1.7) has a unique solution for any P 0 € E + {H) if a > 1/2, whereas if a < 1/2 
they need in addition that the linear operator [Ao — A*] 7 Po is bounded for 
some 7 > 1 — 2a. For some other results in this direction, see M. C. Delfour 
and M. Sorine [1] and M. SORINE [2] using J. L. Lions’ direct method and 
A. J. Pritchard and D. Salamon [1], 

In this chapter we assume {TCP) following the recent paper of F. Flan¬ 
doli [7], and show the existence and uniqueness of the Riccati equation (see 
§2.2 below). Then, we solve the control problem in §2.3. 

We shall not study the Riccati equation (1.7) when a < 1/2 and Pq only 
belongs to E + (H). In this case the cost functional (1.4) is not defined on 
the whole L 2 (0,T;U), (see Remark 1.1), and the Dynamic Programming ap¬ 
proach, based on the direct solution of (1.7), does not work. Concerning the 
existence (but not the uniqueness) of a solution to (1.7) we mention the fol¬ 
lowing results: 

(i) If Po is a positive multiple of the identity, there exists a solution of (1.7) 
and one can also solve the corresponding control problem (1.1)-(1.4) (see 
I. Lasiecka and R. Triggiani [3], and F. Flandoli [5]). 

(ii) There exists Po € E + (H) such that (1.7) does not have a solution (see 
F. Flandoli [5]). 

(iii) A sharp sufficient condition, which is “almost” necessary, for the ex¬ 
istence of a solution of (1.7) is given in I. Lasiecka and R. Trig¬ 
giani [14], 

It is also possible to study generalizations as in §2.7, §3, and §4 of Chapter 1 
in Part I to 

(i) nonhomogeneous state equation, 

(ii) tracking problem, 

(iii) time-dependent state equation and cost function. 

The generalizations (i) and (ii) are straightforward, and they will be left to 
the reader. For the point (iii), which is much more technical, see the papers by 
P. Acquistapace, F. Flandoli, and B. Terreni [1]; P. Acquistapace 
and B. Terreni [3]; and P. Acquistapace [1], 

We end this section by giving two examples concerning the heat equation. 
For a result concerning the strongly damped wave equation, see F. Bucci [1]. 
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Several other examples can be found in the lecture notes by I. Lasiecka and 
R. Triggiani [11]. 

Another approach to boundary control problems using a quadratic cost 
function not necessarily coercive can be found in L. PANDOLFI [1], 

Example 1.1 (Dirichlet boundary condition). Let 12 be a bounded open set in 
with a smooth boundary <912. Consider the optimal control problem: To 
minimize 


J(u)= [ T [ \ x (t,0\ 2 da+ f f \u(t, £)| 2 da + [ \r X (T, -)(?)| 2 d£, 
J 0 J Q J 0 J dQ, J Q 

over all controls u G L 2 ([0,T] x <91i) subject to the state constraints 

! dx 

0 = A(x(t, 0, (t, o G ]0, T[ x ft, 

x(o,€) = xo( 0 > £ g 12 , 

x(t,£) = u{t,£), (t,£) g ]o,r[ x < 912 , 


where xq G L 2 (12), 


A 


= ^d 2 x 

' h d $ 


is the Laplace operator and r G £(L 2 (<912)). 

We set H = Y = L 2 (12), U = L 2 (<912), and introduce the Dirichlet realiza¬ 
tion A of the Laplace operator 


D(A) = H 2 ( 12) n Ax = A^x, Mx G D(A). 


As is well known (see for instance S. Agmon [2]), A is a strictly negative self- 
adjoint operator in L 2 (12), so that assumption (HV)i-(i) holds with Ao = 0. 
Moreover we have 


D{{-AY) 


H 2a { 12), if a G ]0, l/4[, 

{u G H 2a (tt): u = 0 on <912}, if a G ]l/4,1[. 


Let us introduce now the Dirichlet mapping 

v <—> Dv = w: L 2 (<912) —■> L 2 (12), 


where 

Acut = 0 in 0, w(£) = v(£) in <912. (1.11) 

As proved in J. L. Lions and E. Magenes [1], we have D G £(L 2 (9D); Lf 1 // 2 (D)) 
therefore D G £(L 2 (c 212); £)((—A)“))) for any a G ]0, l/4[. Thus Assump¬ 
tions (HV) are verified provided that a G ]0, l/4[, (3 G ] 1/2 — a, l/2[, and 
r G £(L 2 (<912); £)((— A)P))), as noted in R. Triggiani [1], We now show, 
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following A. V. Balakrishnan [4], that problem (1.10) can be set in the 
form (1.1). 

First we assume that u £ W 1 ' 2 (0, T ; L 2 { 912)) and introduce a new variable 
by setting 

y{t,0 =a:(*,£) - (Du(t, •))(?)■ 

We obtain 

[ ||(i,£) = A iV (t,0 0, (t, 0 € ]0, T[ x 11, 

|y(o,0 = *o(0-(^«(o,-))(0. Ceo, 

[y(t,0 = o, (t,()s]o,r[xffi. 

Then, we set y(t ) = y(l, •), u(t) = u(l, •), and write the above problem as 

y(t) = e tA (xo — Du( 0)) — f e ( - t ~ s ^ A Du l (s) ds. 

Jo 

By performing an integration by parts, it is not difficult to check that x fulfills 
(1.1). Finally, the hypothesis u € W 1 ’ 2 ([0, T]; L 2 (911)) can be easily removed 
by regularization. □ 


Example 1.2 (Neumann boundary condition). Let 11 be a bounded open set in 
with a smooth boundary <912. Consider the optimal control problem: To 
minimize 

J(u)= [ T [ \x(t,0\ 2 d£+ [ T [ \u(t,0\ 2 da + 

J 0 J J 0 J dQ, 


[ \rx(T,-m\ 2 dt 
Jn 


over all controls u £ L 2 ([0,T] x 911), subject to the state constraints 

{ dx 

£) = Acx{t , £), (1,0 £ ]0, T[ x n, 

a;(o,C) = x 0 ((), £ e n, ( 1 - 12 ) 

dx 

— {t, £) = u(t, £), (t, 0 £ ]0, T[ x <911, 


where Xo £ L 2 (H), r £ £(L 2 (H)), and v represents the outward normal to 
911. 

We set H = Y = L 2 (Q), U = L 2 (9H), and introduce the Neumann real¬ 
ization A of the Laplace operator 


D(A) = ^x £ H 2 (n): g:=0}, 
Ax = Acx, \/x £ D(A). 


As is well known (see for instance S. Agmon [2]), A is a nonpositive self- 
adjoint operator in L 2 (12), so that Assumption (7TP)i-(i) holds with any 
Aq > 0; we choose Aq = 1. We have 
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D ([Ao - A] a ) 


H 2a {n), 


if ae]0,3/4[, 
ifae]3/4,l[. 


Introduce the Neumann mapping 

v i—> Nv = w: L 2 (dfl) —> L 2 (Q), 


where 

A^w — w = 0 in 12, -^(£) = v (0 in 90. 

As proved in J. L. Lions and E. Magenes [1], we have 

N € C{L 2 (90); H 3 ^ 2 (fl )); 

thus ./V e £(L 2 (90); D([Ao — A] a )) for any a € ]0,3/4[; and Assumptions 
(HV) are verified. Moreover, by proceeding as in Example 1.1, we see that 
problem (1.12) is equivalent to problem (1.1) with D = N and Ao = 1. □ 

Remark 1.2. One obtains similar results for an elliptic operator with general 
boundary conditions (see I. Lasiecka [1]). □ 


2 Riccati equation 

2.1 Notation 


We use here the notation introduced in §2.1 of Chapter 1, and we assume 
that Assumptions (HV) are verified (that is both (HV)\ and (HV) 2 ) hold. If 
P e C s ([a, 6 ]; S + (H )), we set 

V P (t) = [X 0 -A*] 1 ~ a P(t), t £ [a, b\. 

When no confusion may arise, we will drop index P , writing Vp = V. 

We are going to study the Riccati equation 

jp' = A*P + PA - V*EE*V + C*C, 

\P(0) = P 0 , 

where 

E = [A 0 - A] a D. 

We also consider the integral form 


P(t)x = e tA *P 0 e tA x+ [ e^- s)At C*Ce {t ~ s)A xds 

Jo 

- f e i - t - s)At V*(s)EE*V(s)e (t - s)A xds, (2.2) 
Jo 
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where x £ Ed. 

It is useful to introduce the approximating problem for k > Xq: 


P' k = A*P k + P k A - V*E k E*V k + C*C, 


where 


Pk(0) = P o , 


E k = kR(k, A)E, V k = V Pk = [A 0 - A^~ a P k 


and R(k, A) = (k — A) 1 . Problem (2.3) can also be written in mild form as 
follows: 

P k {t)x = e tA * P 0 e tA x + [ e( t - s)A *C*Ce { - t - s)A xds 

Jo 

- f e^ A *\^(s)E k E*V k (s)e^ A xds, (2.4) 
Jo 

where x £ H. 

Remark 2 . 1 . The operators (A, B k ,C, Pq), 

B k = [A 0 - A*] 1 ~ a kR(k, A)[X 0 - A*] a D, 

fulfill assumptions [EL) of Chapter 1. So, by Theorem 2.1 of Chapter 1, equa¬ 
tion (2.4) has a unique mild solution P k £ C s ([0, oo [ ; r+(£ 0 ). □ 

Finally, in order to make simpler some estimates, we introduce a constant 
L such that 

' (i) L> 1, || (A 0 - A) _1 || < L, || (A 0 - A)“ 7 || < L, 

\/' Y £]0,l[,\\E k E* k \\<L, VfceN. 

< (ii) ||e‘( A - A o)|| <L,t\\(A- A 0 )e^- A °)|| 

<L,^||(Ao-A)'V^- a °)|| <L, 

Vy e ]0,1[, Vt>0. 

2.2 Riccati equation for a > 1/2 

Assume that Assumptions (HP) are verified with a > and set, for the 
sake of simplicity, Ao = 0. We shall look for a solution of the Riccati equa¬ 
tion (2.1) in the following functional space. For any interval [a, 6 ] we denote 
by C St0l ([a,b\; E(H)) the set of all P £ C s ([a, 6 ]; E{H)) such that 

! (i) P(t)x € £)((—A*) 1_ “), Wx£H 1 Wt£}a,b], 

(ii) (-A*) 1 - a P£C(}a,b}-,jr,(H)), ( 2 . 5 ) 

(hi) lim(f — a) 1 ~ a (—A*) 1 ~ a P(t)x = 0, \/x £ H. 

t^a 



440 IV-2 Unbounded Control Operators in Parabolic Equations 


Define 

II^IU = sup ||(£ — a) 1_a (—A*) 1 ~ Q P(t)||. 

£E]a,fr] 

Cs,a([u: 6]; E(H)) endowed with the norm 


||P|| a = ||P|| + ||P||i 


is a Banach space. We set 

C s , a ([a,b]-E+(H)) = {PeC a , a ([a,b]-,2(H)):P{t)>0,Vte]a,b]} 

and denote by C SiQ ([0, oo]; S(H)) the set of all P € C s ([0, oo]; S(H)) such 
that P G C s , a ([0,T]-,E(H)) for all T > 0. 

Definition 2.1. A mild, solution of problem (2.1) in the interval [0, T\ is an 
operator valued function P £ C s , a ([0, T]; S(H)) that verifies the integral 
equation 


P(t)x = e tA *Poe tA x + [ e^- s)A 'C*Ce {t ~ s)A xds 

Jo 

e (t-s)A* v *( s j EE * v ^ e (t-s)A xdS ' (2.6) 

where x £ H. A weak solution of problem (2.1) in [0, T] is an operator valued 
function P € C SiQ ([0, T]; E(H)) such that, for any x,y £ D(A), (P(-)x, y) is 
differentiable in [0,T] and verifies 



— (P(t)x,y) = (. P(t)x,Ay ) + ( P(t)Ax,y) + ( Cx,Cy) 


~(E*V(t)x,E*V(t)y), 


,P(0) = P o . 


(2.7) 


□ 


Proposition 2.1. Let P £ C s , a ([0, T]; E(H)). Then P is a mild solution of 
problem (2.1) if and only if P is a weak solution. 

Proof. It is completely similar to the proof of Proposition 2.3 of Chapter 1, 
and so, it will be omitted. □ 

We need, as in Chapter 1, a generalization of the Contraction Map¬ 
ping Principle. Let T > 0, and let {'Jk} be a sequence of mappings from 
C«,a([0, T]; E(H)) into itself, such that 

Il7fc(-P) - lk{Q)\\a < «||P ~ Q||a 

for some a £ [0,1 [ and all P,Q £ C S)a ([0, T]; E(H)). Moreover assume that 
there exists a mapping 7 from C s , a ([0, T]; S(H)) into itself such that VP £ 
C s>a ([0,T};S(H)), Vto G N, Vx £ H 
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f lim 7 ™(P)x = 7 m (P)x, in C([0,T\;H), 

I AC—^OO 

I lim t 1 ~ a (—A*) 1 ~°‘ 7 ^ l (P)x = t 1 ~ a (—A*) 1 ~ a 7 m (P)x, (2.8) 

I k —»oo 

{ in C([0, T]; H), 

Then, by the Contraction Mapping Principle, there exist unique Pk and P in 
C Sia ([0, T\-,E(H)) such that 

7 fc(-Pfc) = Pk, 7 (P) — P- 

The following result can be proved as Lemma 2.1 of Chapter 1. 

Lemma 2.1. Under the previous assumptions on the sequence of mappings 

ilk} 

( lim P k {-)x = P{-)x in C([0, T];H), 

I k—> OO 

{ lim t 1 ~ 0 ‘(—A*) 1 ~ a Pk(-)x = t 1 ~ a (—A*) 1 ~ a P(-)x, (2.9) 

I k—> oo 

[ inC([0,T]-H), \/xGH,T> 0. 

The main result of this section is as follows. 

Theorem 2.1. Assume that Assumptions {HP) are verified with a > 1/2. 
Then, problem (2.1) has a unique mild solution P £ C Sia ([0,T]; S(H)). More¬ 
over, the solution Pk of problem (2.4) also belongs to C St a ([0, T]\£(H)) for 
all k € N and (2.9) holds for all x € H and T > 0. 

Proof. We write problem (2.1) as 

P = 7 (P) = F + H - ip(P), 

where 

F(t) = e tA *P 0 e tA , 

H(t) = f e {t ~ s)A \TCe ( - t ~ s)A ds, 

Jo 

(<p(P))(t)= [ e (t - s)A *V*{s)EE*V{s)e (t - s)A ds. 

J o 

Analogously, we write problem (2.4) as 

Pk = 7 k{Pk) = F + H - C Pk(Pk )> 

where 

(MP))(t)x= f e^ A W,f(s)E k E* k V k (s)e^ A xds, x G H 
Jo 

and V k (s) = V Pk (s). 

In the sequel of the proof T > 0, a € ]0,1 [ and L > 1 are fixed. We proceed 
in several steps. 
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Step 1. 

F,HeC a , a ([0,T\-,E(H)) and 

||F|| a <2L 2 ||P 0 ||, \\H\\ a < (l + -^L 2 ||C|| 2 T. (2.10) 

In fact, we clearly have ||P|| < P 2 ||Po||. Moreover 

\\t 1 - a (-A*) 1 ~ a F(t)\\ = ||t 1 - Q (-^) 1 - a e tA *P 0 e tA || < P 2 ||P 0 || 

so that ||P||i < L 2 1|Po|| and the first inequality in (2.10) follows. Concerning 
the second, it suffices to remark that ||F(t)|| < P 2 ||C|| 2 P and, for all x € H, 

\t 1 - a {-A*) 1 ~ a H(t)\= t 1 ~ a (-A*) 1 ~ a f e {t - s)At C*Ce {t - s)A ds 

Jo 

< P 2 ||C'|| 2 t 1 -“ f (t-s) 01 - 1 ds\x\<-L 2 \\C\\ 2 T. 
Jo a 

Step 2. 

i p and ifik map C Sia ([0, T\; £(H)) into itself. Moreover there exists a constant 
Ci t T > 0 such that, for all k G N and P G C SiQ ,([0, T]\ £{H)) 

||^(P)|| a + ||^(P)|| a <C 1 , r ||P|| 2 , (2.11) 

where 

C\ T = 2 [ + 0(2a -l,a)} T 2a_1 P 3 , 

la — 1 

and (3 represents the Euler function, 

(J(x,y)= [ t x_1 (l-t) J ' _1 dL 

Jo 

We only estimate ||^>(P)|| a . The estimate for ||</?fc(P)||a is similar. Let P G 
C Sta ([0,T]; S(H)) and x G H; then (p{P ) G C s ([0, T]; S(H)) and we have 

\^(P))(t)\ < L 3 J* s 2a ~ 2 ds || P|| i < _L_L 3 ||P||2 T 2 a- 1 , 

which implies 

MP)I1 - ( 2 . 12 ) 

By arguing as in Lemma 3.1 of Chapter 1, it is not difficult to show that 
i p{P) G C SiC( ([0, T]; E(H)). Moreover we have 
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|t 1 -“(-A*) 1 -“(v?(P))(t)| < L 3 < 1_ “ ftt-sT-'s^dsWPWl 

Jo 

< L^WPWlT 201 - 1 f (1 — cr) a—1 (j 2a—2 dcr |x| 

Jo 

= L 3 \\P\\ 2 1 T 2a - 1 p(2a-l,a), 

which yields 

||^(P)||i<T 2 “- 1 L 3 /3(2a-l,a)||P||?. (2.13) 

Now, (2.11) follows from (2.12) and (2.13). 

Step 3. 

There exists a constant Ci,t > 0 such that, for all P, Q € C SjQ ([0, T]\ £(H)), 
we have 


MP) - ^mU+WMn-MQJWa < c 2 , T (\\p\\ a +\\Q\\ a )\\p-Q\\ a , (2.14) 
where 


Ci,t = 2 


1 


2a- 1 


+ /3(2a — 1, a) 


rj-i2ot— 1^3 


In fact, let P, Q £ ^^([0,7]; £(H)), V = Vp, Z = Vq, and x € H; we have 

|i 1_Q (p(-P)) (*)* -£ 1_ “ (<p(Q)) (t) | 

< t 1 - 01 [ e {t ~ s)A *[(V{s)-Z{s))*EE*V{s)]e^- s ' )A ds 

Jo 

+ t 1 -* [ e ^~ s)A * [Z*(s)EE*(V(s) - Z(s))]e {t ~ s)A ds , 

Jo 

and the conclusion follows by arguing as in the second step. 

We denote by B{r,t) the ball 

B(r,t) = {PeC a , a ([0,t]-,£(H)): \\P\\ a <r}. 


Step 4. 

For all p > 0, there exist r = r(p) > 0 and r = r(p ) > 0, such that 

\\Po\\ <P =4- 7 (P(r,r)) U 7 fc (P(r,r)) cP(r,r) (2.15) 

and 


l| 7 (P) - 7(Q)IU < h\\P - Q\\a, hk{P)~lkmU<\\\P~QU (2-16) 

for all P, Q £ 7 (P(r, t)) . This follows easily from the inequalities (2.10), 
(2.11), and (2.14). 
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Step 5. 

Existence and positivity. Choose p > ||Po||, and let r = r(p). By (2.15), (2.16), 
and the Contraction Mapping Principle, it follows that there exist unique P 
and Pk in (^^([O, T]; S(H)) such that 

7 (P) = P, 7 fc(Pfe) = Pk- 

So problems (2.1) and (2.3) have unique solutions P and Pk, respectively, in 
[0, t]. Moreover, by Lemma 2.1 it follows that (2.9) holds for all x G H and 
T > 0. Since, by Theorem 2.1 of Chapter 1, Pk{t) > 0 for all t € [0, r], we 
finally find 

P{t) > 0, for all t € [0, t]. 


Step 6. 

Global existence and uniqueness. We first remark that we have shown exis¬ 
tence in the interval [0, r], which only depends on the norm of Pq- Thus, in 
order to prove global existence we only have to estimate the norm of P(t), 
t G [0,t[. Let P G C's.e*([0, t]; E(H)) be the solution of (2.1) in [0, r] . As 
P(t) > 0, we have 

(P(t)x,x) <(P 0 e tA x,e tA x)+ f \Ce ( - t ~ s)A x\ 2 ds 

Jo 

<L 2 {\\P 0 \\+T\\C\\ 2 }\x\ 2 , 


which implies that 

||P(i)||<||i|| 2 {||Po||+T||C'|| 2 }, for all t G [0, r]. 

Set now pi = L 2 {||P 0 || +T||C'|| 2 } and n = r(p 1 ). Let P be the solution to the 
Riccati equation (2.1) in [0, n]. Proceeding as above, we can solve the Riccati 
equation 


Q(t) = e {t ~ Tl+e)A *P(n - e)e {t ~ Tl+e)A + f e {t ~ s)A *C*Ce (t ~ s)A ds 

J T\—£ 

- f e^ A *V* {s) E*EV Q{s) e^ A ds, 

J T 1 — £ 


in the interval [ti — e, 2ri — e] (here s is a small positive number to be chosen 
later), and we find a solution Q G C gia ([ri — e, 2ri — e]; E{H)) such that 


\\Q(t)\\ < P 2 {||P 0 || + TIICII 2 }, vt g [ n - £ , 2n - e]. 


Now, it is easy to check that setting 
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P(t), ifte[ 0 ,n], 

Q(t), lit e [ri, 2 n -e]-, 


P(t) = 


then P is the unique solution of (2.1) in [0, 2t\ — e]; moreover P(t) > 0 in 
[ 0 , 2 n — e] and 

\\P(t)\\<L 2 {\\P 0 \\+T\\C\\% te[0,2n- e ]. 

Thus we can repeat this argument successively in the intervals [2 ti — 2e, 3ti — 
2e], [3rr — 3e,4n — 3s], and so on. So we get the conclusions in N steps, 
provided N and e are chosen such that IVti > T and 

Nti —T 


The proof is complete. □ 

We now prove the continuous dependence with respect to Pq and C of the 
solutions of (2.1). Consider a sequence of Riccati equations: 


dP h 


= A*P h + P h A - ( V h )*EE*V h + ( C h )*C h 


dt 

P h ( 0) = Pft 


(2.17) 


where V h = V ph , h £ N. Assume that 

{ (i) For any h G N, (A, D, C h , Pq) fulfill (TCP) with a > 
(ii) lim (C h )*C h x = C*Cx, for all x € H, 

h—> oo 

(iii) lim P^x = PqX for all x € H, 

h —>oo 


(2.18) 


and prove the following result. 

Proposition 2.2. Assume that Assumptions (HP) and (2.18) are verified 
with a > 5 . Let P and P h be the mild solutions to (2.1) and (2.17), respec¬ 
tively. Then, for any x £ H and any T > 0, we have 


lim P h (-)x = P(-)x, in C([0, T]; H), 

h—>oo 

lim f 1 -“P /t (-)a: = t 1 _ “P(-)a; in C([0, T]\H). 

h—*o o 


(2.19) 


Proof. Fix T > 0. By the Uniform Boundedness Theorem, there exist positive 
numbers q and c such that 

11 ^ 0*11 <«, \\(C h YC h \\<c, VfteN. 


Set p = L 2 (q + Tc ), r = r(p); then, arguing as in the proof of Theorem 2.2 
of Chapter 1, we first show that (2.19) holds in [0, r] and then we prove that 
this argument can be iterated in the interval [r, 2 r] and so on. □ 
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We finally show a monotonicity property of the solutions of the Riccati 
equation 

Proposition 2.3. Assume that (A, D,Ci, Pi, o) fulfill (HP) for i = 1,2, with 
a > 1/2 and, in addition, that 

Pi ,0 P‘2,0, CfCi < C* 2 C 2 . 

Let Pi, i = 1,2 be the mild solution of the Riccati equations 

j t Pi = A*P t + P,A - VfEE*Vi + ( CifCi , 

PM = Pi, o, 

where Vi = Vp i . Then we have 

Pi(t)<P 2 (t), t> 0. 

Proof. For any k € N, i = 1, 2, let Pi,k be the mild solution to the Riccati 
equation 


( 2 . 20 ) 


( 2 . 21 ) 


I j t Pi, k = A* P h k + P,.,kA - V* k EE*V, k + {CifCi, 

W(0) = Pi, 0, 

where = {—A* k ) l ~ a P.,^. Then, by Proposition 2.2 of Chapter 1, 

P\,k{t) < Pi,k{t), t>0,k&N. 

The conclusion now follows from Theorem 2.1. □ 

2.3 Solution of the Riccati equation for a < 1/2 

We assume here that Assumptions (TCP) are verified with a < 1/2 and some 
/3 € ] 1/2 — a,(l — a)/ 2[. We set again Ao = 0 and denote by Pp G E + (H) the 
closure of (—A*) /3 P 0 (— Af, so that 

P 0 = (-A*)-Pp 0 (-A)-f 

One can see very easily that the proof of Theorem 2.1 cannot be repeated, 
because 2 — 2a > 1 and some integrals would be divergent. Thus we introduce, 
following F. Flandoli [7], a more complicated functional space and some 
additional notations. If [a, b] is any interval, we set 

T[a,b](t) = (t - a) 1_ “^ ,J , te[a,b\, 


and 
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(s — a) 1 a P(t — s)P 

V[a,b]{t,s) = - _ p -, a < s < t < b. 

If P G C s ([a, 6]; E + (H)), we set 

V P (t) = (-A*) 1 ~ a P(t), t£[a,b ], 

W P (t, s ) = {-A*) 1 - a P(s){-Afe {t ~ s)A , a < s < t < b. 

When no confusion may arise, we will drop indexes [a, b] and P , in the formulas 
above. 

For any interval [a, b] we denote by C StOCt p([a,b]; £(H)) the set of all P G 
C s ([a, b\; S(H)) such that (2.5)—(i)—(ii) hold and moreover 

' (i) P(t)x £ D((-A*y- a ) : Vx £ H, \/t £ }a, b], 

(ii) V P £C(]a,b]-,C(H)), 

* (iii) lim /i[ a ,6 ](t)Vp(t)x = 0, Vx £ H, (2.22) 

(iv) lim v< a b ](t, s)Wp(t, s)x = 0, Vx £ H. 

, (t,s)—>(a,a) 

Define 

!|P|| 2 = sup \\^ [aM (t)Vp(t)\\ 

££]a,6] 

and 

||P|| 3 = sup \\V[a,b] (t, s)Wp(t, s)||. 

a<.s<t<.b 

C s ,a, / 3 ([ct, b]\ S(H)), endowed with the norm 

mk/J=||P|| + ||P||2 + ||P|| 3 , 

is a Banach space. We set 

C a<a ,p([a,b\-,E + (H)) = {P £ C a , atP ([a,b\;S(H)): P(t) > 0,Vi G ]a,b}}, 

and let oo[; £(H)) be the set of all P £ C s ([0, oo[; £(H)) such that 

P G C s ^([0,T]-E(H)) for all T > 0. 

Definition 2.2. A mild solution of problem (2.1) in the interval [0, T\ is an 
operator valued function P G C s>a ^([0,T]; S(H)), which verifies the integral 
equation (2.6). A weak solution of problem (2.1) in [0, T] is an operator valued 
function P G C a<ai p([0,T]; £(H)) such that, for any x,y G D(A), (P(-)x,y) 
is differentiable in [0, T] and verifies (2.7). □ 

Proposition 2.4. Let P G C 8tOlt p([0,T]; £(H)). Then P is a mild solution of 
problem (2.1) if and only if P is a weak solution. 

Proof. Completely similar to the proof of Proposition 2.3 of Chapter 1. □ 
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We shall need, as in §2, a generalization of the Contraction Mapping Princi¬ 
ple. LetT > 0, andlet{7fc} beasequenceofmappingsfromC S)ail g([0,T]; S(H)) 
into itself, such that 

|| 7 fc(-P) - lk(Q)\\a < a\\P - Q\\a, 

for some a £ [0,1[ and all P, Q € C Sjaij g([0, T]; Assume moreover that 

there exists a mapping 7 from C s>ai/ 3([0, T]; into itself such that for all 

to € N and all x € H : 

f Jim 1 ^{P)x = 1 m {P)x in C([0, T]\ H), 

J lim n(-)Vyjn( P) x = n(-)V im ( P )X in C([0, T\\ H), 

1 AC—► OO 

lim i/(-,-)Wjm/ P \x = v>(-,-)W 1 m(p\x in C(A T ; H), 

where A T = {(A, s): 0 < s < t < T}, VP G C s>ai/3 ([0, T]; E(H)). Then, 
by the Contraction Mapping Principle, there exist unique P k and P in 
C s ,a,f 3([0, T]; H{H)) such that 

7 k(Pk) = Pk, 7 (P) = P. 

The following result can be proved as Lemma 2.1 of Chapter 1. 

Lemma 2.2. Under the previous assumptions on the sequence of mappings 
{7 k}, for all x G H 

{ lim P k (-)x = P(-)x in C([0,T];H), 

k—> 00 

luf^u(-)V p k {-) x = ti(-) v p(-)x in C([0,T];H), (2.23) 

lim v(-,-)W Pk {-,-)x = v(-,-)W P (-,-)x in C(A t -,H). 

k—>00 

Prior to state the main result of this section, we need another lennna. 
Lemma 2.3. If P G C a>olt p ([0, T\; E(Hf), we have 

||(— A*y- a P(s)(- A)i-“e(*-^|| < 2 1 - a L gl _ a _ /5( ^_ g)(1 _ a) ||P|| 3 . 

Proof. Let t € ]0, T], s € [0, t[ . We have 

(-A*) 1 - Q P(s)(-A) 1 - a e (t - s)A 

= (-A*) 1 -“P(s)(-A) /3 e (t+s/2 - s)A (-A) 1 - a - /3 e (t+s/2 - s)A . 

It follows that 

||(—A*) 1 -“P(s)(—A) 1 “ a e( t - S ) A || _ 

< L(t + - «)"* (-2^) ll-PIU, 


which implies the conclusion. 


□ 
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The main result of this section as follows. 

Theorem 2.2. Assume that Assumptions [TCP) are verified for a < 1/2 and 
some (3 £ ] 1/2 — a, 1 — a/2[. Then the Riccati equation (2.1) has a unique 
mild solution P £ C a>at p([0, oo[; £ + (H)). Moreover, the solution Pk of prob¬ 
lem (2.4) also belongs to C StOlt p([0, oo[; E(H)} for all k £ N and (2.23) holds 
\/x £ H. 

Proof. We write problems (2.1) and (2.4) as 

P = 'y{P) = F + H-'p(P), P k = lk {P k ) = F + H-ip k {P k ), k£N, 

where F, H, ip , and tp k are defined as in the proof of Theorem 2.1. We fix 
T > 0 and proceed in several steps. 

Step 1. 

FgC,^([0,T] ; r(ff)) and 

||F|| a ,£<L 2 ||P 0 ||+2P 3 ||P /3 ||. (2.24) 

We have indeed 

||t 1 -“- / 3 (-A*) 1 - Q P(t)|| = ||< 1 - a - / 3 (-A*) 1 - a - / 3 e tA *P / 3 (-y4)- / 3 e tA ||<L 3 ||P^||, 
which implies 

\\F\\ 2 < L 3 \\Pp\\. (2.25) 

Moreover, if £ € ]0, T\ and s £ ]0, £], we have 

| \u{t, s)(-A*) 1 - Q P(s)(- 2 l) / 3 e (t - s)A || = || v(t, s){-A*) 1 - a - 0 e sA * P 0 e tA \\ 

< L\t-s)/tf\\Pp\\ < L 3 \\Pf 3 \\ 

because (£ — s)/£ < 1. It follows that 

\\F\\ 3 <L 3 \\P 0 \\. (2.26) 

Now (2.24) follows from (2.25) and (2.26) and the estimate ||P|| < P 2 ||Po||. 
Step 2. 

H £C s ^ p (%T]-E{H)) and 
\\H\\ a , 0 < L 2 \\C\\ 2 T +-tfWCfT 1 -? 

Q( p-\~oo 

+P 2 ||C|| 2 T 1 - 2/3+2e / p £ ^ 1 (l+pf dp, (2.27) 

J o 

where £ = \ min{a, /?}. 
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Let x € H\ then 


\t 1 - a - 0 {-A*) l ~ a H{t)x\ = 


< 


It follows that 


j e {t-')A* C * Ce {t-»)A xds 
JO 

ft 1 

LHCft 1 -'*-? / (t — s)"- 1 ds |a:| < -L 2 ||C|| 2 T 1 - /3 |x|. 

Jo a 

||tf|| 2 < -L 2 ||C'|| 2 T 1 “ /3 . (2.28) 

a 


Moreover 

\u(t.,s){-A*) l - a H{s){~Afe^- s)A x\ 

= v{t,a)(-A*f~ a f e {s - a)A * da x 

Jo 


< L 2 \\C\\ 2 is(t, s) f (s — a) a 1 (t — a) 13 da \x\ 
Jo 

rs/(t—s) 

= L 2 ||C|| 2 ^(t,s) / (p) a ~ 1 {l + p)~ 13 dp\x\. 

JO 


As p a £ < [s/(t — s)]" £ , we have 
\u(t,s){-A*) l ~ a H{s){~Afe^- s)A x\ 


< L 2 \\C\\ 2< J -—^ 

< L 2 \\ c'|| 2 t 1 - 2/3+2£ [ 

Jo 


— cUs 1- / 3-6 r s /( t ~ s ) 


dp 


i o 


p 1+e { i + pY 


dp 


+oo 

0 pl+e(l + pY m ’ 


which implies 


limb < tfWCfT 1 -™ £°° ( 2 . 29 ) 

As ||Af|| < L 2 ||C'|| 2 T, the conclusion follows from (2.28) and (2.29). 

Step 3. 

<p and (fik map C SjQij g([0, T]; S(H)) into itself. Moreover there exists two con¬ 
stants C\ > 0 and C 2 > 0 such that for all P € C s ^p ([0, T]; S(H)) 

IM-P)||a,0 + \\<fi(Pk)\\a,p 

< T^^CiWPWl'P + C 2 (\\Ph\\P\\ 3 + ||P||1). (2.30) 


Let P € C a>clt p([0,T]; E(H)); we have 
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MP)\\<L 3 \\P\\l j\t - s) 2a+20 - 2 ds 

J o 1 


2a + 2/3 - 1 

because 2a + 2/3 — 1 > 0. Moreover for all x £ H we have 
\t^- 0 { V {P))(t)x\ = 


L 3 ||P||^T 2 “ +2/3 - 1 , (2.31) 


t i-a-P f e i - t - s)At V^{s)EE*Vp{s)e (t - s)A xds 

Jo 

= t l ~ a ~ 0 [ [(-A*) 1 - a P{s)(-A) 1 - a e {t - s)A Y 

Jo 

EE*{{-A*) l - a P{s)\e (t ~ s)A xds 

By using Lemma 2.3, we obtain 

|i 1 -“-*(p(P))(i)x|<2 1 -“L 3 i 1 - a f s 2a+20 ~ 2 (t - s) 0 - 1 ds\\P\\ 2 \\P\\ 3 \x\ 

Jo 

= 2 1 _Q L 3 t 2Q+2/3_1 [ 0 - 2 Q+ 2 / 3 - 2 (l-a) o ^ 1 da||P|| 2 ||P|| 3 |a;|. 

Jo 

Hence 

IMP)|| 2 < 2 1 -“L 3 T 2 “ +2/3 - 1 f a 2a+20 ~ 2 (l - a) 01 - 1 da\\P\\ 2 \\P\\3- (2.32) 

Jo 

Finally, using once again Lemma 2.3, we find 
|Ki,s)(-^*) 1 - a (^))(s)(-^) /3 e( t -^| 

= u{t,s) f \{-A*) 1 - a P(a)(-A) 1 - a e {s - a)A Y 

Jo 

EE*(-A*) 1 - a P{a){-Afe^ t - a)A }x da 
< 2 1 -“P 3 s 1 -“(t - sf [ S a 2a+20 ~ 2 (t - a)~ 0 {s - a ) 1 " 0 da ||P||||a:|. 


As (t — s) 0 < (t — a) 0 , we obtain 
|t/(t,s)(-A*) 1 - a ( 7 (P))(s)(-A) / 3 e (t - s)A x| 

< 2 1 -“P 3 s 1 -“ [ a 2a+20 ~ 2 (s - a) 1 - 0 da \\P\\ 2 3 \x\ 

Jo 

< 2 1 - a L 3 s 2a+20 - 1 [ p 2a + 2 P- 2 (i - p)“-! dp ||P||( 

Jo 


so that 


|| 7 (P )|| 3 < 2 1_a L 3 S 2a+2/3_1 [ /C ,2«+2/3-2( 1 _ p ) l-a dp ||P||2 ( 2 . 33 ) 

Jo 


and (2.30) follows from (2.31), (2.32), and (2.33). 
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Step 4. 

There exists a constant C 3 > 0 such that for all P,Q € C Sta ^([0,T}; £(H)) 
we have 


\h(P) - 7(<5)lk/3 + IK-Pfc) - i{Qk)\\oc,p 

< C'3T 2a+2/3 ~ 1 (\\P\\a,0 + ||Q||a,/9)||P - Q\\a,0- (2-34) 

The proof is similar to the previous one in Step 3. 

We denote now by B(r,t) the ball 

B(r, t) = {P € C s>a ,p([ 0, t\-£(H )): \\P\\ a ,p < r}. 

Step 5. 


For all p > 0, there exist r = r(p) > 0 and r = r(p) > 0, such that 

11 P(3 11 <P => 7 (B(r,T)) Uy k (B(r,T)) C B(r,r), (2.35) 

and for all P,Q € B(r , r) 


\i{p)-imu,p<h\\p-Q\u,p, 


| 7 k{P) - lk{Q)\\a,0 < §|| P~ Q\\a,p- 

This follows easily from the ineciualities (2.24), (2.27), (2.34), and (2.36). 


(2.36) 


Step 6 . Local existence, convergence, and positivity. 

Choose p > |||| and r = r(p). Then, by (2.35), (2.36), and the Contractions 
Mapping Principle, there exist unique P and Pk in C Siail g([0,T]; £(H)) such 
that 

7 (P)=P, 7 k(Pk)=Pk, (2-37) 

and problems (2.1) and (2.4) have unique solutions P and Pk, respectively, in 

[0,t]. 

Moreover, by Lemma 2.2, (2.23) follows. Finally, by Theorem 2.1 of Chap¬ 
ter 1, we have P/ C (t) > 0 for all t £ [0, r]; this yields 

P(t) > 0 , Vte[0,r]. 


Step 7. Conclusion. 

As the interval [0, r] depends only on the norm of Pp, in order to prove global 
existence, we have to find an estimate for the norm of (P{t))p, t £ [0, r[. Let 
P € C St a t p([0, t]; £(H)) be the solution of (2.1) in [0,r]. Let x £ P((— A) 13 ), 
as P(t) > 0, we have 
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(. P(t)(-Afx , (-Afx) < (P 0 (-Afe tA x, (-Afe tA x) + [ \C(-Afe sA x\ 2 ds 

Jo 

<L 2 {\\P 0 \\+±tP\\C\\ 2 }\x\ 2 , 

which implies 

Wi-A^Pm-An < L 2 {\\Pp\\ + -^\\C\\ 2 ^\x\\ (2.38) 

for all t € [0, r]. Set now 

P = jllP/ill + ■^? l/3 ||C|| 2 ||x| 2 , n = r(p); 

and let P be the solution to the Riccati equation (2.1) in t € [0, n]. Proceeding 
as in Step 6 of the proof of Theorem 2.1, we prove that there exists a unique 
solution of (2.1) in [0, 2 ti — e] and so on. The proof is complete. □ 

We now prove the continuous dependence with respect to Pp and C of the 
solutions of (2.1). Consider the sequence (2.17) of the Riccati equations. We 
assume that 

! (i) for any he N, (A, D, C h , P$) fulfill (HP) with a <1/2, 

(ii) lim ( C h yC h x = C*Cx, for all x € H, ( 2 .39) 

(iii) lim Pg x = Pax for all x € H, 

n—> oo ^ 

and we prove the result 

Proposition 2.5. Assume that Assumptions (TCP) and (2.39) are verified for 
a < 1/2. Let P and P h be the mild solutions to (2.1) and (2.17), respectively. 
Then, for any x e H and any T > 0, we have the following properties: For 
all x e H. 

! lim P h (-)x = P(-)x in C([0, T};H), 

h—> oo 

lim n(-)V P h(-)x = n(-)V P (-)x in C([0,T]-H), (2.40) 

h—> oo 

lim i/(-, -)Wpk (•, -)x = u(-, -)Wp(-,-)x inC\AT',H). 

h—> oo 

Proof. Fix T > 0. By the Uniform Boundedness Theorem, there exist positive 
numbers qp and c such that 

V/ieN, \\Pp\\ < qp, \\(C h yC h \\<c. (2.41) 

Set 

P = L 2 (qp + , T = r(p). 

Then, arguing as in the proof of Theorem 2.2, we first show that Pk —> P in 
C s ([0,t]; S(H)) and then we show that this argument can be iterated in the 
interval [r, 2r] and so on. □ 



454 IV-2 Unbounded Control Operators in Parabolic Equations 


Finally, the following result can be proved as Proposition 2.3. 

Proposition 2.6. Assume that (A,D,Ci,P^ o) fulfill Assumptions (TCP) for 
i = 1,2, with a < 1/2, and, in addition, that 

Pip < P2,o, C*Ci < C 2 C 2 , 

Let Pi, i = 1,2, be the mild solution of the Riccati equations (2.21). Then we 
have 

Pi(t)<P 2 (t), t> 0. 

3 Dynamic programming 

In this section, we are going to solve minimization problem (1.4) associated 
with the state equation (1.1). In the sequel, this will be referred to as prob¬ 
lem (1.1)-(1.4). We assume that Assumptions (HP) are verified with Ao = 0 
(recall that under Assumption (HP) 1 properties (1.2) and (1.3) are verified) 
and denote by P and Pk the solutions of the Riccati equations (2.1) and (2.4), 
respectively, given by Theorems 2.1 and 2.2. We set also V = Vp, 14 = Vp k . 
We shall extend the arguments of §6 of Chapter 1 based on the fundamental 
identity (3.1) and the solution of the closed loop equation (3.2) below. 

Proposition 3.1. Let u £ L 2 (0,T;t/) and let x be the solution to state equa¬ 
tion (1.1). Then the following identity holds: 

(P(t)xo,Xo) + [ |u(s) + E*V(t - s)a:(s)| 2 ds 
Jo 

{|Ca;(s)| 2 + Ks)| 2 } ds + ( P 0 x(t ), x(t)). (3.1) 

Proof. Let u £ L 2 (0,T;U) and let x be the solution to (1.1). Let {uk} be a 
sequence in W 1,2 (0,T; U) such that Uk —»■ u in L 2 (0,T; U), and let Xk be the 
solution to (1.1) corresponding to Uk■ We have, as can be easily checked, 

Xk(t) = e tA a;o + Duk(t ) — f e ( - t ~ s ' >A Du' k (s) ds. 

Jo 

By Proposition 3.8 in Part II, Chapter 1, it follows that x k (t) is differentiable 
for any t £ ]0, T] and 

x' k (t) = Ae tA x 0 - A f e^- s)A Du' k (s) ds. 

Jo 

Now we compute the derivative 

^-(P k (T - s)x k (s),x k (s)), 

and integrating from 0 and T and letting k tend to infinity, we get (3.1). □ 
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Let us consider now the closed loop equation 

x(t) = e tA x 0 - f (-A) 1 - a e {t ~ s)A EE*V(T - s)x{s) ds. (3.2) 
Jo 

Remark that the right-hand side of (3.2) is meaningful for any t £ [0, T[ 
because 


|| {-A) 1 -°‘e (t - s)A EE*V(T - s)|| 

< f L 2 \\P\\ a [(T - s)(t- a )]-- 1 if a > 1/2, 

- [tfWPW^iT-sr+P-^t-sr- 1 if a <1/2. 

Proposition 3.2. Assume that Assumptions (TLV) hold. Then the following 
statements hold true: 

(i) If a > 1/2, there exists a unique solution of (3.2), x € C([0,T\; H). 

(ii) If a < 1/2, there exists a unique solution of (3.2), x £ C([0,T[- H) and 
a constant C > 0 such that 

\x(t)\<C(T-t)-*, t £ [0, T[. (3.4) 

Proof. For any y £ C([0,T\;H), we set 

X(y)(t)= [ {-A) 1 - a e {t - s)A EE*V(T ~ s)x{s)ds, t £ [0,T], 

Jo 

We first prove (i). Assume a > 1/2; then by (3.3) using the Holder estimate, 
we have 

\(X(y)m\ < L 2 \\P\\ a [\t - sr~\T - s)"- 1 ds |b||c([ 0 ,t];H) 

Jo 

< L 2 \\P\\a {fit - s) 2a ~ 2 ds f(T - s) 2a ~ 2 d S | ||t/||c([ 0 ,t];/D 

< 2^Ti i2 ll P ll“ t2a_1 ll*/llc([o,t];/0> 

so that A £ C(C{[ 0, t]\H)) for any t £ ]0, T] and 

ll^lk(C([o,t];/f)) < 2 a _ ^ L ~\\P\\at 2a 1 - 

Thus, if t is small, A is a contraction and (3.2) has a unique solution in 
C([0,t];H). Now this argument can be repeated in [t, 2t] and so on, giving 
the conclusion. We now prove (ii). Fix T\ £ ]0,T[, and let a < 1/2 and 
(3 £ ] 1/2 — a, 1 — a/2[. By (3.3) we have 
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mv)m\ < L 2 \\P\\ a , 0 [\t - sT~\T - sT+P- 1 ds ||y|| C ([o, t ];/o 
Jo 

< L 2 \\P\UAT - tr+e- 1 f S “- 1 ds |||/||c([ 0 ,t]iff) 

Jo 

< -L 2 \\P\\aA T - Ti) a+fl - lta \\y\\c(\ 0 A-,H), te [ 0 , 71 , 

a 

so that A G £(C([0, t];H)) for any t G ]0, Ti] and 

l|A|U(C([0,t];H)) < ^L 2 \\P\\ a ^(T - T 1 )°+/»- 1 t«. 

Thus, if t is small, A is a contraction and (3.2) has a unique solution in 
C([0,t}; H), and proceeding by iteration, we prove the first part of (ii). 

It remains to show (3.4). Following F. Flandoli [7], we set 

z(t) = V(T-t)x(t), t G [0, T[. (3.5) 

Then z verifies the equation 

z(t) = V{T - t)e tA x 0 - f V(T - t){-A) 1 - a e {t ~ s)A EE*z(s) ds. 

Jo 

Taking into account Lemma 2.3, it follows that 

('r-i) 1 -“-'V(i)| < L|cro|||F|| a>/ 3+2 1 -“L 2 ||P|| a ^ ['(T-sfit-s^zis^ds. 

Jo 

Finally set w(t) = (T — z(t); then we have 

\w(t.)\ < L\X 0 \ \\P\\a,0 

+ 2 1 -“L 2 ||F|| a>/3 f (T — s) a+2/3_1 (t — s) a_ 1 |w(s)| ds 

Jo (3.6) 

< L\x o| \\P\\ a ,f, 

+ 2 1 ~“L 2 ||P|| a>/3 f (t - s) 2a+20 ~ 2 \w(s)\ ds. 

Jo 

As 2 — 2a — 2/3 < 1, by the Gronwall’s lemma, we have |w(f)| < K , for some 
K > 0 and all t G [0, T[. It follows that 

\z(t)\ < KiT-t) 01 ^- 1 , t G [0, T[. (3.7) 

Now, from (3.2), we have 


c(i) | < L|s 0 | + L 2 I< [ (t- sr-^T - s) a+ ^- 1 ds 

Jo 

rt/T—t 

= L\xq\ + L 2 K(T - t ) 2a+/3 “ 1 / a 01 - 1 ^ + <7 ) Q +^ —1 da. 

Jo 
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As a 2 ^ 20 - 1 < ( t/T - t) 2a+20 -\ it follows that 

/•OO 

\x(t)\ < L\x 0 \ + L 2 KT 2a+20 -\T - t)~ 0 / cr a+20 (l + <r) a+0 - 1 da, 

Jo 


and the proof is complete. □ 

We now prove the main result of this section. 

Theorem 3.1. Assume that Assumptions (TCP) are verified and let Xo € H. 
Then there exists a unique optimal pair (it*, x*). Moreover the following state¬ 
ments hold: 

(i) x* is the mild solution to the closed loop equation (3.2) and x * G 
C([0,T]-,H ) if a G ]±,1[, whereas x * G C(\0,T];H) n L 2 (0,T;H) if 
“G]0,|[. 

(ii) u* G C([0,T];U) is given by the feedback formula: 

u*(t ) = -E*V(T - t)x*(t). (3.8) 

(iii) the optimal cost J(u*) is given by 

J(u*) = (P(T)x 0 ,*o). (3-9) 

Proof. Let u G L 2 (0,T; U) and let y be the solution to state equation (1.1). 
Then, by (3.1), we have 


(P(T)x o,x 0 )+ \u(s) + E*EV(T - s)x(s)\ 2 ds = J(u). (3.10) 

Jo 

It follows that 

(P(T)x 0 ,x 0 ) < J(u) 

for all u G L 2 (0,T;U). Now, let x* be the solution of the closed loop equa¬ 
tion (3.2). By Proposition 3.2, x * belongs to C([0,T]; H) if a < \ and to 
L 2 (Q,T\H) if a > \ (due to the estimate (3.4)). Now, let u* be defined by 
(3.8) and set u = u *, x = x* in (3.10). We find (P(T)x o,xq) = J(«*), so that 
u* is optimal. Finally, the uniqueness of the optimal control can be proved as 
in the proof of Theorem 6.1 in Chapter 1. □ 
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Unbounded Control Operators: Hyperbolic 
Equations With Control on the Boundary 


1 Introduction 

As before, we shall denote by H, U, and Y the Hilbert spaces of states, 
controls, and observations, respectively, and consider a dynamical system, 
whose state x(-) is the solution of the following equation: 

jx'(t) = Ax(t) + Bu(t), te[0, T], 

|y(0) = x 0 £ H, 

where u £ L 2 (0, T; U) and A: D(A) C H —> H generates a strongly continu¬ 
ous group on H. We identify the elements of H' with those of H so that the 
linear operator (A*)*: H —> D{A*)’ is a linear extension of the linear opera¬ 
tor A: D(A) —> H. As in the previous chapter, the linear operator B is not 
supposed to be bounded from U into H, but it belongs to C(U; D(A*)') , or 
equivalently, B is of the form B = (Ao — A)E, where E £ C(U; H) and Ao is an 
element in p(A). More precisely, following I. Lasiecka and R. Triggiani [1, 
2, 11], we shall assume that 

(i) A generates a strongly continuous group e tA in H of type too 
and Ao is a real number in p(A) such that u>q < Ao, 

(HH)il (h) E£C{U-,H), 

(hi) 3K > 0 such that [ \E*A*e sA *x\ 2 ds<K 2 \x\ 2 , Vx£D(A*). 

, J o 

If assumptions {TLTi)i hold, then we can give a precise meaning to the state 
equation. We have in fact the following result due to I. Lasiecka and 
R. Triggiani [1, 2, 11], 

Proposition 1.1. Assume that (TtTl)i is verified, and for each control func¬ 
tion u £ L 2 (0,T; U), define 
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z(t) = f s ^ A Eu(s)ds, t G [0,T], (1.1) 

J o 

Then z(t ) G Zl(Al) for all t € [0,T] anti ^42 G C([0, T]\ H). Moreover the 
following inequality holds: 

\Az(t)\ < tG[0,T]. (1.2) 

Proof. We divide the proof into two steps. 

Step 1. 

z(t) G Z?(j4) for all t G [0, T\. 

If x £ D(A*) we have 

(z(t),A*x) = f (u(s),E*A*e (t - s)A *x)ds. 

Jo 


It follows that 

\(z(t),A*x)\* < ||u||£ a(0 , r;to f \E*A*e^ A \\ 2 ds 

Jo 

^ ^ 2 II ^11 L 2 (0,T; tt) 1*^1 2 ' 

If we identify elements of H' with those of H, then this inequality implies 
that the linear form x i—> (z(t), A*x) on ff, is continuous, and hence that 
z(t) € D(A) and that (1.2) holds. 

Step 2. 

Az € C([0, T]; H). 

Let {«„} be a sequence in IU 1,2 (0, T; U) such that u n converges to u in 
L 2 (0, T ; U). Set 

z n = f e^~ s ^ A Eu n (s) ds. 

Jo 

It follows that z n G C([0, T]\D{Af) (cf. Part II, Chapter 1, Proposition 3.3). 
Now setting w n {t) = Az n (t), w n G C([0,T}-, H) and we have 

| w(t) - Wn{t) I 2 = \Az(t) - Az n (t) I 2 < K\\u — Mn|| 2 2 (0)T; ( 7 ) 0 

as n —> oo uniformly in [0,T]. The proof is complete. □ 

In the sequel we shall write the solution of the state equation as follows: 

x(t) = e tA xo + G(u)(t) 

= e tA xo + (Ao — A) f eJ~ s ^ A Eu(s) ds. 

Jo 


(1.3) 
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By Proposition 1.1, G G £(L 2 (0, T; U); C([0, T];H)). 

We now consider the following optimal control problem: To minimize 

J(u)= l T {\Cx{t)\ 2 + \u(t)\ 2 }dt+(P 0 x(T),x{T)) 1 (1.4) 

J o 

over all u G L 2 (0,T;U), subject to the state equation constraint (1.3). In 
addition to the assumptions (HH) i, we assume that C G £(H;Y), 

P 0 G E+(H). 

In the sequel ( HTL) will mean that both assumptions (HH )i and (HH )2 are 
verified. We shall also say that (A, E,C, Pq) fulfill ( 'H.'H .). From now on we 
assume for simplicity that Ao = 0. 

The definitions of optimal control, optimal state, and optimal pair are as 
in the previous chapters. 

We again study the optimization problem (1.3)—(1.4) by using Dynamic 
Programming. However, in the current case, new technical difficulties arise. 
Consider in fact the Riccati equation that we formally write as follows: 

(P' = A*P + PA- P(E*A*)*E*A*P + C*C, 

|P(0)=P 0 . 

If the data C and Po are regular or more precisely if the linear operators 
\fp\)A and CA admit bounded extensions, ^/PqA and GA, then problem (1.5) 
can be easily solved. In fact by setting R = A*PA it reduces to 

\R' = A*R + RA — REE*R + (CA)*CA, 

|p(o) = (TWayTWa, 

which has a unique solution by Theorem 2.1 of Chapter 1. 

However these conditions on C and Po are not natural, so we prefer to 
proceed in the following different way: 

(i) We consider the approximating problem 


P' = A*P n + P n A - P n {E*A*)*E*A* n P n + C*C, 

P( 0 ) = Po, 


where A n = nAR(n , A) are the Yosida approximations of A, and prove 
the convergence in C s ([0, T]; E(H)) of the sequence {P n } to an element 
P. 

(ii) For any bGN we consider the control problem: To minimize 

Jn(u)= f {\Cx n (t)\ 2 + \u{t)\ 2 }dt+(P 0 x n {T),x n {T)), (1.7) 

Jo 

over all u G L 2 (0,T; J7), subject to the constraint 



462 IV-3 Unbounded Control Operators in Hyperbolic Equations 


I x' n (t) = Ax n (t) - A n Eu(t), te[0,T\, 

|x n (0)=a;o. 

Denote by (it*, a;*) the corresponding optimal pair given by Theorem 6.1 of 
Chapter 1. Then we prove that (it*,a;*) converges to the optimal pair of 
problem (1.4) with state equation (1.3). 

Notice that we avoid the difficulty of giving a general definition of a solu¬ 
tion of the Riccati equation (1.5); for us the solution will namely be the limit 
of the sequence { P n }. The proof of the existence of this limit is given in §2, 
whereas in §3 we shall see how to use this result to study the initial optimal 
control problem. 

For an existence and uniqueness result, under suitable regularity assump¬ 
tions on C and P 0 (weaker than the ones discussed before), see G. Da Prato, 
I. Lasiecka, and R. Triggiani [1], Finally we notice that in the previ¬ 
ously quoted papers by I. Lasiecka and R. Triggiani, explicit formulas 
for the solutions to the Riccati equation and the optimal pair (even under 
more general assumptions) are constructed by generalizing the representation 
formula (2.22) of Chapter 1. 

In §5 we shall consider, following V. Barbu and G. Da Prato [1], the 
case when e tA is a general semigroup, and a condition similar to (TLTL) holds. 
In this case we are able to define a solution of the Riccati equation by using 
the dual Riccati equation introduced in §7.3 of Chapter 1. 


2 Riccati equation 


We assume here that (HH) is verified and consider the Riccati equation (1.6), 
whose mild solution is denoted by P n . For the sake of simplicity, we assume 
that Pq £ C r (H), that is, that Pq is invertible with a bounded inverse (cf. 
Chapter 1, §5); at the end of this section, we shall explain how to handle the 
general case. 

Following F. Flandoli [2], we consider the Riccati equation 


O' = -AQ - QA * - QC*CQ + {.E*A*)*E*A *, 

<2(0) = Pol¬ 


and 

/ Q’ n = - AQ n - Q n A * - Q n C*CQ n + (E*A* n )*E*A* n , 

\Q n (0) = p-\ 

where A n = nAR(n , A) are the Yosida approximations of A. As the linear 
operator E*A* fulfills the assumptions of Theorem 4.1 of Chapter 1, problem 
(2.1) has a unique mild solution Q that belongs to C s ([0, T]; E(H)) and we 
have 

lim Q n = Q mC s ([0,T]-,E(H)) 

n —»oo 


(2.3) 
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and 

Q n (t)=P~ 1 (t), Vt > 0. (2.4) 

Theorem 2.1. Assume that ('HH ) is verified and that Po G C r (H). Let P n 
be the solution to the Riccati equation (1.6). Then we have 

lim P n = P in C s ([0, T]; E(H )), (2.5) 

n —* oo 

where P(t ) = <3 _1 (t), t G [0,T] and Q is the mild solution of (2.1). 

We shall call P the mild solution of (1.5). 

Proof. It is sufficient to prove that there exists a constant C\ > 0 such that 

||P n (i)|| < C u Vt G [0, T], Vn G N. (2.6) 

In fact, if (2.6) holds, then we have 

IIQ" 1 ^)!! < C*!, VtG [0,71, VnGN. 

Thus Q(t) G C r (H), Vt G [0,T]. Moreover from the identity 

Q _1 (t) - P n (t) = P„(t)[Q n (t) - Q(t)]<3 _1 (t), 

one can prove the existence of the limit (2.5). Finally to prove (2.6), it is 
sufficient to observe that 

Pnft) < e tA *P 0 e tA + f e {t - s)At C*Ce {t - s)A ds. 

Jo 


The proof is complete. □ 

Remark 2.1. Assume that (HH) is verified and that Po, V £ r (H) with 
Po < Po. Let P and P be the corresponding mild solutions of (1.5). Then we 
have P(t) < P(t), Vt > 0. □ 

Remark 2.2. Assume that Po does not have a bounded inverse, and denote by 
P e the mild solution of (1.5) with Po replaced by Po+eP Then by the previous 
remark P e is decreasing and so the limit of P e exists in C s ([0,T]; S(H)) as e 
goes to zero. □ 


3 Dynamic programming 

Here we assume that (HH) is verified. We denote by P and P n the mild 
solutions of (1.5) and (1.6), and by (u*,x*) (resp. (u*,x*)) the optimal pair 
for the control problem (1.3)-(1.4) (resp. (1.7)-(1.8)). 

We first consider the case when P 0 G C r (H). 
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Theorem 3.1. Assume that ('HH ) is verified and that P 0 € C r {H) fl S + (H). 
Then we have 

(i) lim„_ >00 u* = u* in L 2 (0,T-,U), 

(ii) linin^oo x* = x * in C([0, T];H). 

Proof. Let u € L 2 (0,T;U) and let x be given by (1.3) and x n by (1.8). 
We remark that, as x n {t) = e tA Xo + n{nl — A)^ 1 G(m), we have x n —» x 
in C([0, T\\H). Now by formula (6.2) in Chapter 1, it follows that 


(Pn(T)x 0 ,x 0 ) + [ \u(s) + E*A* n P n (T - s)x n (s)\ 2 ds 
Jo 

= f [\Cx n (s)\ 2 + \u(s)\ 2 }ds + (P 0 x n (T),x n (T)). (3.1) 

Jo 


Setting u = u* in (3.1), we find 


(P n (T)x 0 ,x 0 )= f [|G<(s)| 2 + K(s)| 2 ]ds+(P 0 <(T),<(T)). (3.2) 

JO 


Thus we have 


(P(T)x 0 ,x 0 ) <J(u), Vue L 2 (0,T;U). (3.3) 

Moreover from identities (3.1) and (3.2) the sequence { u *} is bounded in 
L 2 (0,T;U ) and so there exists a subsequence {u* fc } that weakly converges 
to an element u of L 2 (0,T; U ). As 

<*(■) = S{-)x 0 - n k R(n k , A)G(u* nk ) 

and 

G« k )--G(u) in L 2 (0,T; H), 

we have 

x* nk ^x in L 2 (0,T; H) 1 

where 

x = S(-)x o — G(u), 

and the symbol — 1 denotes the weak convergence. 

By letting n go to infinity in (3.2), we have 

(P(T)x 0 ,x 0 ) > Jt{u), 

which, along with (3.3), yields u = u*, x = x* and 

(P(T)xq, x 0 ) = J T {u*). 

Thus the sequence { u *} weakly converges to u* and it only remains to 
prove that u* —> it*. By (3.2) we have 
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[ll II L 2 (0,T;C7) + II x n II L 2 (0,T;H) + I V^> x n(T)\ 2 ] 

< J(u*) = ||w*|||, 2 ( 0)T;l 7 ) + ||a:*||| 2 (o ) T;H) + k /Pox*(T)\ 2 . 
As 


<->•«* in L 2 (0,T; U), 
x* n -+x* in L 2 (0, T ; H), 
y/Pox* n (T)-±y/j^x*(T) in H, 


as n —> oo, it follows that the above convergences are strong. The proof is 
complete. □ 

We now consider the case where Pq £ £ + (H) is not invertible. Define for 
any £ > 0, the cost 

J e (u) = / T {|Ca;(t)| 2 + |it(f)| 2 } dt + (P 0 x(T), x(T)) + e\x(T)\ 2 , 

J o 

and let (it*, x*) be an optimal pair for the corresponding control problem. Let 
moreover P e be the mild solution of the Riccati equation (1.5) with Pq replaced 
by Pq +eI. As we know (see Remark 3.1), P e is convergent in C s ([0, T\; £(H)) 
to an element P £ C s ([0, T]; E(H)'), which has been defined as the mild 
solution of (1.5). 

Theorem 3.2. Assume that (HTL) is verified and that Pq £ £ + (H). Then 
there exists a unique optimal pair (it*, x*) for the control problem (1.4) subject 
to the state equation (1.3). Moreover 

(i) lim e ^o u* = u* in L 2 (0,T;U), 

(ii) lim^o®* = x * in C([0, T]; H). 

Proof. We have 


(P £ (7>o,;ro) < J e (u), Vit £ L 2 (0,T;t/), 

(Pe(T)xo,x 0 ) = J {\Cx*(t)\ 2 + \u*(t)\ 2 }dt 

+ (P 0 x(T),x(T))+e\x*(T)\ 2 . 

We notice that the seciuence {it*} is bounded in L 2 (0,T; U); we have in fact 


(3.4) 

(3.5) 


/ K(s)| 2 ds < Je«) < MO), 
Jo 


where 


J e (0) = f \Ce sA x 0 \ 2 ds + (P 0 Ce TA x 0 , Ce TA x 0 ) + e\e TA x 0 ' 2 
Jo 

It follows that there exists a seciuence {e*,} { 0, and elements u £ L 2 (0, T; U ), 
x £ C([0, T]\H) such that 



466 IV-3 Unbounded Control Operators in Hyperbolic Equations 


(i) u Ek u in L 2 (0, T ; U), 

(ii) x Ek x in L 2 (0,T;H), 

(iii) x Ek (T) ->■ x(T) in H. 

Moreover 

x(t) = e tA xo — A ( e^~ s ^ A Eu(s) ds, t G [0,T]. 

Jo 

Now from (3.4) it follows that 

(P e (T)x 0 ,X 0 ) < 

and by (3.5) 

(Pe(T)x 0 ,x 0 ) > J s (u). 

The conclusion follows arguing as in the proof of Theorem 3.1. □ 


Remark 3.1. We shall denote by P m j n the mild solution of the Riccati equation 
corresponding to Pq = 0. By Remark 2.1 it follows that P m i n is the minimal 
nonnegative solution of the Riccati equation. □ 


4 Examples of controlled hyperbolic systems 

Let A: D(A) C H —» H be a linear operator, infinitesimal generator of a 
strongly continuous group e tA and let E: U —* H be a linear bounded op¬ 
erator. In this section we shall discuss several examples such that the key 
condition (7t7t)-(iii) is fulfilled. We start with a very simple example. 

Example 4.1 (first order problem). 

Consider a system 

= *e[0,rue [0,27r], 

j*(0,O = *o(O, ^ e [o, 2 tt], 

\x(t, 2 -k) = x(t, 0) + u(t), t £ [0,T]. 

We choose here H = L^(R), the set of all 27r-periodic functions that belong 
to L 2 ( 0, 27r; R), and U = R. We consider the linear operator A in H 

ID(A) = W^’ 2 (R) = {x£ L|(R): x' G L|(M), ®(0) = a;(27r)}, 
yAx = x', \/x G D(A). 

As it is well known, A is the infinitesimal generator of the strongly continuous 
group of translations 


e tA x(f) = x(t + £), f GR, (gK. 
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We proceed here as in the Example 1.1 of Chapter 2. First we assume that u 
is differentiable and introduce a new variable y by setting 

e « 

y(t,0 = a :(<,£) - ^ _ j u{t), 
so that state equation becomes 

= ||(t,0 + - «'(*)), t G [0,T], £ G [0, 27t], 

* y(0,0 = z 0 (£) - _ 1 m( 0) = 2/o, £ G [0,2 tt], 

y(t,2n) = y(t,0), fG[0,T]. 

Now we can write this equation in abstract form, namely 

y{t, ■) = e tA y 0 + [ e {t ~ s)A z 0 {u{s) - u'(s)) ds, 

Jo 

where zq is the element of L# (R) defined by 

20 (0 = e 2„ _ £e[0,27r]. 

By integration by parts we eventually find that the state equation can be 
written in the required form 

x'(t) = Ax(t) + (1 — A)Eu(t ), x(0) = xo, 

where the linear operator E G C(U; H) is defined as 

Ea = azo, \/a £ U = R. 

Observe that the adjoint operator E* G C{H\ U) is defined as 

E*x = (x, zo), Vx G H. 

We now check condition iii). Let t G [0,27r] and x G W# 2 (R). If 

s G [0, 27t] we have 


E*A*e sA x = (A*x,e sA zo) 


I r p2tt—s n2 7 T 

— {J x'(0e s+i dC + J 2 _ x'(0e sU ~ 271 

= a;(27r — s) — (x, e sA zo ). 


It follows that 


I E*A* 


1 ds < 2 f \x(2n — s)\ 2 ds + 2t f \(x, e sA zo)\ 2 ds 

Jo Jo 


< 2(1 + f 2 |z 0 | 2 )M 2 - 


Thus condition is fulfilled. 


□ 
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Example 4.2 (Abstract wave equation). 

Let Z , U be Hilbert spaces, A: D(A) C Z —> Z a linear self-adjoint strictly 
positive operator, D a linear operator in C(U;Z ), and Ao > 0. Here we are 
dealing with the system 

y"(t) + Ay(t) + (A§ + A)Du(t) = 0, t > 0, ^ 

2/(0) = 2/o, 2/(0) = 2/i • 

In order to write problem (4.1) in the form (1.3), we have to introduce the 
space D(A~ 1 / 2 ) defined as the completion of Z with respect to the norm 
ll^llz?(yi—i/ 2 ) = ||H _1 / 2 :e||. Then we choose as space of states and observations 
H = Z © D(yl -1 / 2 ), endowed with the inner product: 

) = (. x°,x°)z + (A-Wx^A-Wx 1 )^ 

and dehne the linear operator A on H 



AX = 


0 1 

-A 0 


D{A) = DiA 1 / 2 ) 


VX G D{A), 


A is the infinitesimal generator of a strongly continuous group of contractions, 
given by the formula 


e tA = 


cos (yl 1 / 2 ^) A 1//2 sin(H 1 / 2 t) 
— A 1 / 2 sin(yl 1/,2 f) cos(yl 1 / 2 t) 


, t GR. 


Setting now 


X(t) = 


y'(t ,■) 


1 -^0 — 


we can write (4.1) as 


f X’{t) = AX(t) + (A 0 - A)Eu{t), t > 0, 

\X(0)=X 0 , 


(4.2) 


where E: U —> H is defined by 


Eij = — 


Dy 
A 0 Dp 


We remark that the adjoint of E, E*: H 

„oi 


E* 


= -£>*( x u - 


T] G U. 

U is given by 
AoH -1 )^ 1 . 


It follows that 
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E*A*e tA ' 


= —D*A 1/2 sin(A 1/2 t)x° + D* cos(rl 1/2 t)a; 1 

+ \ 0 D*A~ 1 cos(A l/2 t)x° + X 0 D*A 1/2 sin (A^x 1 . 


Now it follows easily that condition (HH)-(iii) is fulfilled if and only if there 
exists Ki > 0 such that 


Ki(t)\z\ 2 , VzeDiA 1 / 2 ), 

(4.3) 

Ki(t)\z\ 2 z , Vz G D(A 1 ' 2 ). 

□ 

Example 4.3 (Wave equation). 

Let O be a bounded set in R” with a regular boundary 90. Consider the 
problem 

y tt {t,Z) = Azy{t,Z), f > 0, (eft, 

y(t,£) = u(t,g), t> o, £ e 90, (4.4) 

y(o,0 = yo(0, yt{o,0 = 2/1 (0> £ e O. 

We set Z = L 2 (0) and U = L 2 (dtt) and denote by —A the Laplace operator 
with Dirichlet boundary conditions in O. Then, setting y(t) = y(t, •) and 
u(t) = u(t, •) and denoting by D the Dirichlet mapping defined in Example 1.1 
of Chapter 2, we see that problem (4.4) is equivalent to problem (4.1) with 

A 0 =0. 

We now prove (W^)-(iii); for this it is enough to show the first inequality 
(4.3), because the second one can be proven similarly. Thus we fix 2 £ D(A) 
and set 


/ \D*A l/2 sin(A 1/2 s)z\u ds < 
Jo 

f \D*A 1 / 2 cos{A 1 / 2 s)z\u ds < 
Jo 


w(t) = D*A 1 / 2 sin(A 1 / 2 t)z, v(t) = A~ x ' 2 sin(Rl 1/2 t)^; 
we remark that 

. , dv , . 

»(() = ^(t), 

where v is the the outward normal to 90 (because D*A coincides with the 
linear operator d/dv). Moreover v(t,-) — v(t) is the classical solution to the 
following problem: 

= t> o, £eo, 

< v(t,£) =0, t > 0, £ € 90, (4.5) 

l u(0,£) = 0, v t ( 0,0 = zo(£), £ G O. 


Fix T > 0, to prove the first inequality in (4.3), it suffices to prove that there 
exists a constant C\ > 0 such that 
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f T 

dv 

/ (T-t) 

J 0 



L 2 (dQ) 


dt < Cl I x 0 11,2(0). 


(4.6) 


For this purpose, we follow the proof in I. Lasiecka, J. L. Lions, and 
R. Triggiani [1], We consider a regular vector field h in Q that extends the 
outward normal v, then we multiply the first equation in (4.5) by (T—t)h-\/^v 
and set 


1=1 (T — t)vtth -V dtd£, J= / (T — t)(A^v)h ■ V^v dt df, 
JQ Jq 

” denotes the scalar product in R n . 


where Q = [0,T]xll and “ 

Step 1. Estimate of I. 

We have 

t=T 

I = f [(T — t)(h ■ X7£v)vt] df + f (h • V ^v)vt. dt df 

J Q t—0 J Q 

- f (T - t){h ■ \/^v t )v t dt df = h + h + h- 

Jq 

Clearly, I\ = 0; moreover, by the usual energy estimates, there exists C 2 > 0 
such that 

h < C 2 \xo\l HQy (4.7) 

Concerning I 3 we have 


h = - 


1 f (T — t) div^(hv 2 ) dt df + ^ f (T — t)v 2 div^ hdt df 

2 Jq 2 Jq 

= — / (T — t)v 2 h ■ udtda + 7 - / (T — t)v 2 div^ h dt df. 

2 J[o,T]xon 2 Jq 

The first term is equal to 0 because v = 0 on dfl; moreover the second one 
can be estimated as I^- Thus, there exists a constant C 3 > 0 such that 


|/| < C2\xo\ 2 L 2(ny 


(4.8) 


Step 2. Estimate of J. 


Using Gauss-Green formulas for the term J, we obtain the boundary term in 
(4.6) minus the term J\ given by the expression 


n p 

J\ = ^ / (T— t)d^ i vd^ i (hjd^ J v)dtd(, 
i,j=i Jq 

n p Up 

= / (T — t)de :i vdc i hjdc.vdtdf+ / (T — tfhjd^yvd^vdtdf, 

, Jq Jq 


i,j= 1 ' 


i,j =1 
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where denotes the partial derivative with respect to £* and d{j = di(dj). 
Then 


i,j= i' 


Th A _| Th A 

J\ = ^ / (T — fydfrhjd^vdfrvdtd£, + - / (T — t)hjd^(d^v) 2 dtdt; 

i j —i Q i j=\ " Q 

Th A _| 11 A 

Ji = V / (T- t)d ii h J d ij vd ii vdtd£+ - V / (T - 1)9^ [/ij|%u| 2 ] 

- 1 ^ i,j=l •■'Q 

1 , n /■ 

- 2 H J Q ( T ~ *)%l %^| 2 dt ^ 

+ i f (T — t)\X7£v\ 2 dt da 

2 J[o,T]xc>n 


*d=i 


= A'i 


= Ad + 


1 


/ CT-i) 

dio.Tixan 


2 J[o,T]xan 
because t)=0on 9ti and 

Now 


9v 

9^ 


dt da, 


dv 


h ■ Ve = 2— on 9fi. 
cw 


|Ai| < C l 4|a;o| i 2(Q) 

for some constant Cd > 0. We have 


J = -Ad + 


U (T~t) 

z 4[0,T]xOO 


9u 

9^ 


dt da. 


Finally as I = J 


fiT-t ) 

Jo 


dv 

dv 


dt — d T A 4 , 


L 2 (9fi) 


(4.9) 


(4.10) 


(4.11) 


so that the required estimate (4.6) follows from (4.9), (4.10), and (4.11). □ 


Remark 4.1. One can consider different situations such as the wave equa¬ 
tions with Neumann Boundary conditions, or the plate equations with several 
boundary conditions. As for the verification of the condition (7d7d)-(i), the 
reader is referred to the review paper by I. Lasiecka and R. Triggiani [11], 

□ 


5 Some result for general semigroups 

In this section we do not assume that A generates a strongly continuous group 
but that a condition weaker than (HH)i holds. 
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(i) 

(ii) 

(iii) 


A generates a strongly continuous semigroup e tA in H of 
type to o and Ao is a real number in p(A) such that uq < Ao, 
E £ C(U ; H), 

3K > 0 such that f \E*A*e sA x\ 2 ds<I\ 2 \x\ 2 , \/x £ D(A*). 

Jo 


If we replace (HH) i with (HH)i Proposition 1.1 still holds true as can easily 
be seen and the state equation (1.3) is meaningful. We consider again the cost 
function (1.4) and assume that (HH )2 is verified. We denote by (HH)' the set 
of all hypotheses (HH)^ and (HH) 2 - Besides the Riccati equation (1.5) and 
the approximating equation (1.6) we consider, as in V. Barbu and G. Da 
Prato [1], the dual Riccati equation 


I O' = AQ + Q^4* - QC*CQ + (E*A*)*E*A*, 

| Q(0) = 0 , 

as well as the approximating problem 

f Q’ n = AQ n + Q n A* - Q n C*CQ n + (E*A* n )*E*A* n , 

1<3n( 0)=0, 


where A n = nAR(n, A) are the Yosida approximations of A. 


Proposition 5.1. Assume (HH)' and let P n € C s ([0, T\; E(H)) be the mild 
solution of (1.6). Then there is P € C s ([0, T]; E(H)) such that the following 
limit exists: 


lim P n = P, inC s ([0,T]-,E(H)). 

n—* oo ' 


In the sequel we shall call P the mild solution of (1.5). 

Proof. We first remark that the hypotheses of Theorem 4.1 in Chapter 1 are 
verified, so that problems (5.1) and (5.2) have mild solutions, and moreover 
the following limit exists: 


lim Q n = Q in C S ([Q,T}-E(H)). 

n—> oo 


Denote by Ct a positive constant such that 


\\Qn(t)\\< C T , Vt e [0,T], n e N. (5.3) 

Fix now t £ [0,T]. Then by Theorem 7.4 in Chapter 1 we have 


Pn(t) = Uc n , t (t, 0)[/ + PoQnit)]- 1 PoUQ n t (t, 0) 

+ / U Gn:t (t,s)C*CU^ nt (t,s)ds, (5.4) 
Jo 

where 

Gn.t(s) = A* — C*CQ n (t — s), s £ [0, t]. 

Therefore U Gntt is the evolution operator with respect to G n ^. 
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Step 1. 

There exists C\ > 0 such that 

||f/ G „, t (r, S )||<Ci, V(s, t), 0 < s < t < t, and Vn G N. (5.5) 
In fact let x G H and set y> n (r) = Uc nit (T, s)x. Then we have 

¥>n(r) = e (T_s)A x- f e (r ^ CT)A C*CQ n (t - a)ip n (a) da. 

J S 

Let Mt > 0 such that 

\\e sA \\<M T , Vs G [0,T]. 

Then, recalling (5.3), we obtain 

Wn{r)\ < Mt \x\ + M t C f |^„(cr)| da, 

J S 

and the conclusion follows from Gronwall’s lemma. 

Step 2. 

We have 


lim Ug„ t (t, s)x = Uc t (t, s)x, \/x G H, 0 < s < t < t. (5.6) 

n—>-oo ’ 

Let x G H and set ^„(r) = Ua n:t {T, s)x and <p(r) = Ug„(t, s)x. Setting 
Cn(') = <p( m ) ~ ‘Pni •)> then ( n is the mild solution of the following problem: 

f C( r ) =A*( n (r)-C*CQ n (t - r)C„(r)+C*C(Q n (t - r)-Q(t - r))<p(r), 

Un(0) =0, 

that is to the integral equation 

Cn(r) = f U Gn , t ( T ~ a)C*C(Q n (t - a) - Q(t - a))<p(a) da. 

J S 

Now (5.6) follows from (5.5). 

Step 3. 

Conclusion. It is sufficient to let n tend to infinity in (5.4). □ 

We can now proceed as in §3. Let (u*,x*) (resp. (it*, ar* )) be the optimal 
pair for the control problem (1.3)-(1.4) (resp. (1.7)-(1.8)). 

Then the following result is proved as Theorem 3.1. 

Theorem 5.1. Assume that (HH') is verified and that Pq G £ + (H). Then 
we have 
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(i) lim^oo u* = u* in L 2 (0,T;U), 

(ii) lim^ooo:* = x * in C([0, T]\H). 

Example 5.1 (Age-dependent equations). 

Consider a dynamical system describing the evolution of a certain popu¬ 
lation (see for instance G. F. Webb [5]), governed by the equations 


p t (t,a)+p a (t,a) + n(a)p(t,a) = 0, ae[0,a+], t > 0, 

p(0,a) =p 0 {a), a€[0,a+], 

p(£, 0) = / j3(b)p{t,b)db + u(t), t > 0. 

Jo 


(5.7) 


Here p(t, a) is the density of the population of age a at time t, p is the mortality 
rate, (3 is the birth rate, a+ is the maximal age, and u is the control. We shall 
assume that p > 0, (3 > 0, p, f3 € C' 1 ([0, a+]) and 


r a + r a + ( rd 

/ p(b) db = + 00 , / (3(b) exp < — / p(c)d< 

J o Jo ( Jo 


c > db ^ 1. 


We want to minimize a quadratic cost function of the form 

r T r (•«■+ 


r 1 r a + 

J(u) = / dt / p 2 (t, a) da + u 2 (t) 


(5.8) 


(5.9) 


Jo U o J 

over all controls u € L 2 (0,T) subject to state equation (5.7). 

As shown in G. Da Prato and M. Iannelli [1], problem (5.7) can be 
written on the abstract form 


p(t) = e tA po — aA f e^ s ^ A Eu(s)ds, t&[0,T], (5.10) 

Jo 

where A is the infinitesimal generator of a Co semigroup on H = L 2 (0,a+) 
and I? is a mapping from R into H. More precisely the operator A is given by 


a def / 

Aip = —<p — pip, 


D(A ) = -|i p £ H: ip' + pp> £ H and (/?(0) = J (3(b)ip(b) db j- , 


and E is defined by 


H , 


x i—> E(x) = tt(x) : ] 
where n is the element of H given by 

7r(a) = e~J° ^ b ) db ae[0,a + ]. 


(5.11) 


(5.12) 

(5.13) 


Moreover the semigroup generated by A is given by 
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„tA _j B^(t — a)7r(a) ifae[0,£[ _ ^ r2 


e (p = 


, y? G L (0, a+), 


(5.14) 


y>(a — t)n(t) if a € [t, a+] 
where B is the solution to the integral equation 

B(a) = F v (a) + ( K(a — b)B(b) db, a€[0, a+], (5.15) 

J o 


and 


F v (a) = [ ip(b - a)K(b)-^- db, ae[0,o+]. (5.16) 

J a 7T(0) 

We now check hypotheses (HH)'. It is sufficient to show that (HH)i (iii) 
holds. If ip £ D(A*) we have in fact 


r a + 


\E* A*e tA *<p \ 2 dt = / \(A*e tA ~<p,n)\ 2 dt 


r a + 


* 


r a + 


tA„ 


s <we ‘“" 


dt. (5.17) 


Moreover, recalling (5.14), we have 

d d ( f* f a+ ) 

— (<y9,e tA 7r) = — j J ip(a)B n (t- a)n{a)da + J tp(a - t)n(t) da j 

= (p(t)B n (0)ir(b) + f (f(a)B' 7r (t — a)7r(a)da 

Jo 

— y>(a+ — t)n(t) + / ip(a)n' (t) da. 

Jo 

Now, by plugging (5.18) into (5.17) the conclusion follows. 


(5.18) 

□ 



Part V 


Quadratic Optimal Control: Infinite Time 

Horizon 






Bounded Control Operators: Control Inside 
the Domain 


1 Introduction and setting of the problem 

As in Chapter 1 (Part IV) we consider a dynamical system governed by the 
following state equation: 


x'(t) = Ax(t) + Bu(t), t> 0, 
a:(0) = xq € H, 


and we use the notation introduced in §1 of that chapter. We assume that 

! (i) A generates a Co semigroup e tA in H, 

(ii) B£C(U;H), 

(hi) C £ C(H; Y). 

Clearly, if the assumptions ( TL)oo hold, then the assumptions (Tt) of §1 in 
Chapter 1 (Part IV) are verified with Pq = 0. 

We want to minimize the cost function: 

/*00 

Joo(u) = / {|Cx(s)| 2 + |ii(s)| 2 }ds, (1.2) 

Jo 

over all controls u £ L 2 ( 0, oo; U) subject to the differential equation constraint 
(1.1). We say that the control u £ L 2 (0, oo; U) is admissible if Joo(u) < oo. 
An admissible control u* £ L 2 (0, oo; U) is called an optimal control if 

Joo{u*) < Joo(u), Vu G L 2 (0, oo; U). 

In this case the corresponding solution of (1.1) is called an optimal state and 
the pair (u*,x*) an optimal pair. 

Simple examples in finite dimension show that admissible controls can 
fail to exist. When, for any Xq £ H 1 an admissible control exists, we say 
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that ( A,B ) is stabilizable with respect to the observation operator C, or, for 
brevity, that (A, B) is C-stabilizable. In this case it is still possible to solve 
problem (1.1)—(1.2) by using Dynamic Programming. In fact when there exists 
an admissible control, one can show that the minimal solution P m in(t) to the 
Riccati equation (2.7) in §1 of Chapter 1 in Part IV, that is the solution 
corresponding to the initial condition Pq = 0, converges, as t —> oo to a 
solution of the algebraic Riccati equation: 

A*X + XA-XBB*X + C*C = 0. (1.3) 

Moreover (1.3) has a nonnegative solution if and only if ( A , B) is C-stabilizable. 
The minimal nonnegative solution of (1.3) is the main tool in solv¬ 
ing problem (1.1)—(1.2). In fact one can show (see §3) that if (A,P) is C- 
stabilizable, then the optimal control u* is given by 

«*(*) = -B*P™ n x*(t), (1.4) 

where x * is the solution to the closed loop equation: 

fx'(t) = (A - BB*P™ in )x(t), t G [0, T\, 

^cr(O) = xo G H. 

The operator 

F = A-PP*P“ n (1.6) 

is called the feedback operator. It is important for the applications to know 
whether F is exponentially stable or not. A sufficient condition for this is that 
(A, C) be detectable, i.e. that ( A *, C*) be /-stabilizable. This condition is also 
necessary if // is finite dimensional or in special situations (see §3). In §4 we 
study some qualitative properties of the solutions of (1.3). In particular we 
find that if F is exponentially stable, then P^? n is globally attractive (among 
all nonnegative solutions of Riccati equations), and so it is the unique solution 
of (1.3). We also study the existence of a maximal solution P(f ax of (1.3). We 
prove that a maximal solution P^ ax exists if (A, B) is /-stabilizable. In this 
case one can show that the infimum of Joo(n) over all u G L 2 (0, oo; U) such 
that x G F 2 (0,oo; H), subject to the differential equation constraint (1.1), is 
precisely (P^xo, x 0 ). 

We end §4 by studying periodic solutions of Riccati equations. Finally §5 
is devoted to examples and §6 to complements. 


2 The algebraic Riccati equation 

We assume here that (7/)oo is verified and consider the system (1.1). 

Definition 2.1. (i) (A, B) is said to be stabilizable with respect to the 

observation C, or C-stabilizable, if for any xo G H there exist u G 
i 2 (0, oo; P) such that Cx G F 2 (0,oo;V), where x is the corresponding 
solution to (1.1). 
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(ii) ( A, B) is called feedback stabilizable with respect to the observation C, 
if there exists K G C(H; U), N > 0, lo > 0 such that 

\\ Ce t (A -BK)\\ < Ne~ u \ Vt > 0. □ 

We consider the Riccati equation 

P' = A*P + PA-PBB*P + C*C (2.1) 

and the corresponding stationary equation 

A*X + XA-XBB*X + C*C = 0. (2.2) 

In the sequel we shall consider only nonnegative solutions of (2.1) and (2.2). 

Definition 2.2. (i) We say that X G E + {H) is a weak solution of (2.2) if 

(Xx, Ay) + ( Ax , Xy) - (B*Xx, B*Xy) + {Cx, Cy ) = 0 (2.3) 

for all x, y G D(A). 

(ii) X is called a strict solution of (2.2) if X G D(A) (the operator defined 
by (3.3) in Chapter 1 (Part IV) and 

A(X) - XBB*X + C*C = 0. (2.4) 

□ 

We remark that if X is a strict solution of (2.2), then by Proposition 3.1 
(Chapter 1, Part IV), we have 

A*Xx + XAx - XBB*Xx + C*Cx = 0 (2.5) 

for any x G D(A) (because if x G D(A) then Xx G D(A*)). 

Finally we introduce the following definition. 

Definition 2.3. We say that X G E + (H) is a stationary solution of (2.1) if it 
coincides with the mild solution of (2.1) with initial condition P(0) = X. □ 

Proposition 2.1. Let X G E + {H), then the following statements are equiv¬ 
alent: 

(i) X is a weak solution of (2.2). 

(ii) X is a strict solution of (2.2). 

(iii) X is a stationary solution of (2.1). 

Proof, (i) ==> (ii). Assume that (2.3) holds for any x,y G D{A). Then we 
have 

Vx{x,y) = {B*Xx,B*Xy) - ( Cx,Cy ), \/x,y G D(A), 

where <px is the bilinear form defined by (3.1) in Chapter 1 of Part IV. Clearly 
(fix is continuous in H x H so that X G D{A) and (2.4) holds. 
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(ii) => (i). Let A € D(A) be a strict solution of (2.1) and let x G D(A); 
then Xx G D(A*) and (2.5) holds true. Now, if x, y G D(A), (2.3) follows and 
X is a weak solution. 

(ii) => (iii). If X is a strict solution of (2.2), then P(t) = X is a strict 
solution. Therefore it is a stationary solution, of (2.1). 

(iii) => (i). Let X be a stationary solution of (2.1), and set P(t) = X. 

Then by Proposition 2.1 in Chapter 1 of Part IV, P is a weak solution of (2.1) 
so that (2.3) holds and X is a weak solution of (2.2). □ 

Due to Proposition 2.1, all kinds of solutions are the same; in the sequel 
we shall call a solution both a weak and a strict solution of (2.2). 

We are going to study existence of a solution of the algebraic Riccati 
equation. We follow here A. J. Pritchard and J. Zabczyk [1], It is useful 
to consider the solution of the Riccati equation with initial condition 0, 

( p> = A*P + PA- PBB*P + C*C, . . 

(p< 0) = 0. (2 ■ 6, 

Its solution will be denoted by P m ; n (-). 

Remark 2.1. P m i n (-) is the minimal nonnegative solution of the Riccati equa¬ 
tion. In fact if Pq G E + (H) and P is the mild solution of (2.1) such that 
P(0) = Po, then by Proposition 2.2 in Chapter 1 of Part IV, we have 

Pmin(t) < P(i), Vi > 0. 

It follows that if A is a solution of (2.2), then 

Pmin(i) < A, Vi > 0. □ 

We now prove the following properties. 

Proposition 2.2. The following statements hold: 

(i) for any x G H, (Pmin(-)x,x) is non decreasing, 

(ii) assume that, for some R G E + (H), we have 

Pmin(i) <R, Vi > 0. 

Then for all x G H the limit 

P^inx = lim P mi „(i) x, (2.7) 

t—>oo 

exists, and P£f in is a solution of equation (2.2). 

Proof. Let £ > 0, t > 0 and let P be the solution of (2.1) such that P(0) = 
Pmin(e)- By Proposition 2.2 in Chapter 1 of Part IV, we have 


Pmin(i + e) = P(t) > Pmin(i) 
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and (i) is proved. Assume now P m in(t) < P; as P m i n (t) is nondecreasing and 
bounded we can set 

7 ( 2 ;)= lim (P m in(t)x, x), Mx G H. 

t—> OO 

For x,y G H we have 

2 Re(P min (t)a;, y) = (P m in(t)(x+y),x+y) - {P m in{t)x, x) - (P m i n (t)y, y), 
2Im(P min (t)x, y) =i(P min (t)(x+iy), x+iy) - (P min (t)x, x)- (P min (t)(iy), iy). 

So the limit 

P(x, y) = lim ( P m in{t)x, y), Mx, y G H, 

t—> OO 

exists and the following operator P^ ln G E + (H) can be defined: 

lim (P m i n (t)x, y) = (P™ in {t)x, y), Mx, y G H. 

t—> OO 

It follows that 

lim ([P^ n - P m in(t)]x,x) = 0, x G H, 

t —>-00 

which is equivalent to 

lim (P“ n - P min (t)) 1/2 x = 0, Mx G H. 

t—> OO 

This implies that 

lim (P^? n - Pmin (t)) x = 0, Mx € H, 

t —>OO X 7 

so that (2.7) holds. It remains to show that P^ m is a solution of (2.2). For 
this we denote by Ph the solution of (2.1) for which P^(0) = P m in(h), i.e. 
P h (t) = Pmin (h + t). As 

lim P mi „(/i) x = P^ in x, Mx G H, 

h—> 00 

by Theorem 2.2 in Chapter 1 of Part IV, we have 

lim P h {-)x = P^ n x in C([0, T};H), Mx €H,MT> 0. 

h—> 00 

Moreover P^ n is a solution of (2.1) (hence stationary). 

Remark 2.2. Assume that there exists a solution X G S + (H) of (2.2). Then, 
by Proposition 2.2 and Remark 2.1, the solution P£? n defined by (2.7) exists. 
By the above proposition it follows that 

P% n < X, 


for all solution X G X + (H) of (2.2). Thus P^? n is the minimal solution of the 
algebraic Riccati equation (2.2). □ 
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We now prove that a nonnegative solution of the algebraic Riccati equation 
exists if and only if (A, B) is C-stabilizable. 

Proposition 2.3. Assume that (TL)oo is verified and that (A, B ) is C-stabil- 
izable. Then there exists a minimal solution P^ n of (2.2). 

Proof. We first recall that by (6.2) in Part IV, Chapter 1, we have 

(Pmin{t)x 0 ,X 0 ) + [ \u(s) + B* P min (t ~ S)x{s)\' 2 ds 
Jo 

{|C:r(s)| 2 + |u(s)| 2 } ds, (2.8) 

for any xq £ H and any u £ L 2 ( 0, oo; U), where x is the solution of (1.1). Let 
u be a control in L 2 (0,oo;t/) such that the corresponding solution x of ( 1 . 1 ) 
is such that Cx belongs to L 2 (0,oo;V). By (2.8) it follows that 

nOO 

sup(P min (t)x 0 ,x 0 ) < / {|Ca:(s)| 2 + |u(s)| 2 } ds < oo 

t> 0 Jo 

for any Xq £ H. By the Uniform Boundedness Theorem it follows that P m i n (t) 
is bounded, so that, by Proposition 2.2, there exists a solution of (2.2). □ 

In order to prove the converse result it is useful to introduce, for any t > 0, 
the following auxiliary optimal control problems over the finite time horizon 
[0, t]: To minimize 



Jt(u)= I {\Cx(s)\ 2 + \u(s)\ 2 }ds, (2.9) 

Jo 

over all controls u £ L 2 (0,t; U) subject to the differential equation constraint 
(1.1). By Theorem 6.1 in Part IV, Chapter 1, we know that there exists a 
unique optimal pair ( Xt,ut ) for problem (2.9), where Xt is the mild solution 
to the closed loop equation: 

{x' t (s) = [A- BB*P min (t - s)]x t (s), 0 <s<t, 

\a:t(0) = x’o, 

and ut is given by the feedback formula 

u t (s) = -B*P min (t - s)xt(s), 0 < s <t. 

Moreover the optimal cost is given by 

(Pmin(t)x 0 ,X 0 ) = f {\Cx t (s)\ 2 + \u t {s)\ 2 }ds. (2.10) 

Jo 
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Lemma 2.1. Assume that the minimal solution P^ in of (2.2) exists. Denote 
by Xoo the corresponding mild solution to the equation 

(x' 00 (s) = [A-BB*P£ n \x 00 (s), s> 0, 

\®oo(0) = Xo, 

and set 

u 00 (s) = -B*P^ n x 00 (s), s > 0. (2.11) 

Then we have 

lim x t (s) = Xoo (s), s > 0, (2-12) 

t—> OO 

lim Ut(s) = Woo(s), s > 0. (2-13) 

t—* OO 

Proof. Fix T > t and set zt = Xt — Xoo', then for all 0 < s < T, Zt is the mild 
solution of the problem: 


z , t (s) = [A-BB*P ia i n (t-s)]z t {s) + BB*[P in i n (t-s)-P™ in ]x 00 (s), 

z t ( 0) = 0. 


(2.14) 


Denote by U (r, s ) the evolution operator corresponding to A — BB*P m i n (t—-); 
then for x £ H 

j U(r, <j)x = e^ r ~ a ' >A x — ( e^ r ~ p ^ A BB*P m i n {t — p)U(p, a)x dp, 
[U(a,a) = I. 

It follows that 

\\U(r,a)\\<Me( r -^ + M\\B\\ 2 \\P~ n \\ f e^~^\\U(p, a)|| dp. 

J a 

By Gronwall’s Lemma we have 

\\U(r,a)\\ < Me( r - <T) [“+ M||fl||,||J 2 , > 111 , 0 < a < r < T. (2.15) 

We now return to problem (2.14), which we write in the form 

zt(s)= [ U(s,a)BB*[P min (t-a) - P^ ln ]xoo(a)da. 

Jo 

By (2.15) and by the Dominated Convergence Theorem we obtain Zt(s) —> 0 
as t — » oo. So (2.12) and then (2.13) follow. □ 

We can now prove the following proposition. 

Proposition 2.4. Assume that there exists a solution of (2.2). Then {A,B) 
is C-stabilizable. 
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Proof. Let x t and tt t be defined as in the lemma. By (2.10) we have for t > T 


( p ™in x o,x 0 )> [ {\Cx t (s)\ 2 + \u t (s)\ 2 } ds 
Jo 

and, as t —> oo, 

( P ™in X 0, x o) > I {|CXoo(s)| 2 + |'U 00 (s)| 2 } ds. 

Jo 

But as T is arbitrary we find 

cOO 

(-P^dn^’O^o) > / {|C'£C 00 (S)| 2 + |Uoo(s)| 2 }ds 

Jo 

and thus ttoo G L 2 (0, oo; U) is an admissible control. 


(2.16) 

(2.17) 

(2.18) 
□ 


3 Solution of the control problem 

We now consider the control problem (1.1)—(1.2) and prove the central result. 

Theorem 3.1. Assume that the conditions (7Y)oo ore verified and that (A,B) 
is C-stabilizable. Then there exists a unique optimal pair (■u*,x *) for the op¬ 
timal control problem (1.1)-(1.2). Moreover the following statements hold: 

(i) x* € C([0, oo[; H) is the mild solution to the closed loop equation (1.5). 

(ii) u * € C([0, oo[; U) is given by the feedback formula 

u*(t) = -B*P% n x*(t), t G [0,T], (3.1) 

where represents the minimal solution of (2.2). 

(iii) The optimal cost Joo(u*) is given by 

Joo(u*) = (P“„x 0) xo). (3.2) 

Proof. Let u € L 2 (0,oo ;U) and let x be the corresponding solution of the 
state equation (1.1). By the identity (2.8) we have 

{Pmm(t)xo,X 0 ) < \ {| Cx(s) | 2 + | u(s) | 2 } ds < Joo (u ). 

Jo 

It follows that 


Joo(u) > (. P™ in (t)x 0 ,x 0 ), VuG L 2 (0, oo; U). 

Let now Uqq be defined by(2.11); by (2.18) we have 

(-^min(^)*^0? ^o) ^ ^00(^00)5 
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so that itoo is optimal. Formula (3.1) with u* = u ac , x* = Xoo follows from 
(2.12)-(2.13). It remains to show uniqueness. Let (u,x) be another optimal 
pair; then Joo(u) = (-F^n^o, x$). Fix T > 0. By applying (2.8) with t > T we 
obtain 

\u(s) + B*P mln (t - S)f(s)| 2 ds < Joo(m) ^ {Pmin(t)x 0 ,X 0 ) 

< (1-P.Sn - Pmin(T)}x 0 ,X 0 ). 

As t, —> oo we have 

| U(s) + B*P min x(s)\ 2 ds < ([P ” n - Pmin{T)]x 0 ,X 0 ), 

and letting T tend to oo, necessarily u{s) = —B*P£? n x(s). Consequently x is 
also a solution of the closed loop equation that necessarily coincides with x^. 
Then u = Uao and the proof is complete. □ 

We now give a regularity result for the optimal pair (u*,x*). 

Proposition 3.1. Assume that the conditions of Theorem 3.1 are verified and 
let (u*,x*) be the optimal pair for the control problem (1.1)—(1.2). Then the 
following statements hold: 

(i) If xo € D(A), then x* is a strict solution of (1.5) and belongs to 

C' 1 ([0, oo[; H) n C([0, oo[; D{A)). 

(ii) If e tA is an analytic semigroup, then x* is a classical solution of (1.5). 

Proof, (i) follows from Proposition 3.3 in Part II, Chapter 1, and (ii) from 
Proposition 3.9 in Part II, Chapter 1. □ 

3.1 Feedback operator and detectability 

We assume here that the conditions (TL) are verified and that ( A,B ) is C- 
stabilizable. We denote by P^ in the minimal solution of the algebraic Riccati 
equation (2.2). Under these hypotheses, by Theorem 3.1, there exists a unique 
optimal pair ( u*,x *), and 

x*(t) = e tF Xo, t> 0, 

u*(t) = -B*P™ in x*(t ) = -B*P™ in e tF x o, t > 0, 

where 

F = A~BB*P™ n 

is called the closed loop operator. Moreover, by (3.2) we have 

/»00 

= / {\Ce tF xo\ 2 + \B*P™ n e tF x 0 \ 2 \}ds. 

JO 




(■^min^'O) X 0 ) 


(3.3) 
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Remark 3.1. When C = I (or if C -1 G C(H)), by (3.3) and Datko’s Theorem, 
it follows that F is exponentially stable. In particular, if ( A,B ) is stabilizable 
with respect to the identity I then it is feedback stabilizable. □ 

It is important for the applications to give conditions under which F is 
stable (even when C is not invertible). A sufficient condition is given by the 
detectability property. In order to define detectability we introduce the dual 
system 

= A*y(t) + C*v(t), t> 0, 

\y( 0) = Vo G H. 

For this system the space of states, controls, and observations are H : Y, and 
H , respectively. 

Definition 3.1. We say that the pair ( A , C) is detectable if the pair (A*, C*) 
is I-stabilizable. □ 

Remark 3.2. By Remark 3.1 it follows that (A, C) is detectable if and only if 
there exists K G C(Y ; H) such that A — KC is exponentially stable. □ 

The next result is due to W. M. Wonham [2] in the finite dimensional 
case and to J. Zabczyk [3] in the general case. 

Proposition 3.2. Assume that ( A,C ) is detectable. Then F is exponentially 
stable. 

Proof. Let Xo G H, x(t) = e tF xo ; by Remark 3.2 there exists I\ G C(Y\H) 
such that A — KC is exponentially stable. As 

F = (A - KC) + (KC - BB*P™ n ), 

we have that x is the mild solution to the problem 

(x' = (A — KC)x + z, 

\z(0) = x 0 , 

where z = (KC — BB*P£f ln )x. It follows that 

x(t) = e t{ - A ~ KC) xo + [ e^- s)(A - KC) [KC - BB*P™ n }x(s) ds. 

Jo 

By (3.3) we have that Cx and BB*P£f in x belong to L 2 (0, oo;ff); it follows 
that x G L 2 (0, oo;H) because A — KC is exponentially stable. By Datko’s 
Theorem this implies the conclusion. □ 

Remark 3.3. The assumption that (A, C) is detectable is not a necessary con¬ 
dition that F = A — BB*P£f in be exponentially stable, as Example 3.1 below 
shows. Notice however that this condition is necessary and sufficient in some 
special cases (see §3.2). □ 
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The following example was discussed in the reference of G. Da Prato 
and M. C. Delfour [1, 2], 

Example 3.1. Let H = U = Y = £ 2 , the Hilbert space of all the sequences 
{x n } of complex numbers such that \ x n \ 2 < oo. We set 


A{x n } = 


B = I, C{x n } = 


/2 n +1 


Then (2.2) reduces to 


and we have 


2 AX - X 2 + C 2 = 0, 


-^min — A + \f A 2 + C 2 — A + I, 

F = A - P£? n = -I 

Thus F is exponentially stable. We now show that (A, C) is not detectable. In 
fact assume, by contradiction, that (A. C) is detectable. Then the algebraic 
Riccati equation 

2 AX - C 2 X 2 + 1 = 0 
has a positive solution X and we have 

X{x n } = {(n + l)x n }. 


However this is not a bounded operator in F[. 


3.2 Stabilizability and stability of the closed loop 
operator F in the point spectrum case 

We assume here (7i) 00 -(i)-(ii); we are interested in the stabilizability of the 
system (1.1) under suitable conditions on the spectrum of A. We denote by 
a~(A), a + {A), and <J°(A) those elements of the spectrum of A that have a 
negative, positive, and zero real part, respectively. The elements of (t + (H) U 
er°(H) are called unstable points of cr(A). Obviously, if a + (A)Ua°(A) is empty 
and if A verifies the spectral determining condition (see Part II, Chapter 1, 
§2.9 §2.9), then (A,B) is stabilizable. We now assume that 

the set <J + (A) U cr 0 (A) consists of a finite set of 
eigenvalues of finite algebraic multiplicity, 
there exists e > 0, Na > 0 such that 

sup Re A < —e, ||e 4 ^I7)(|| < NAe~ et , Vt > 0. 

A£<7 - (A) 

Here 77)( represents the projector on a~ (A) defined by 
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n 4 — J R(X,A)dX 

and 7“ is a simple Jordan curve around cr _ (A). The projectors 774 and II A 
are defined analogously. We set 

Ha = 77^ (77), 77+= 77+(77), 77° = 77° (77). 

Then 7/4, TTj, 77^ are invariant subspace for the semigroup e*^. 

Remark 3.4. Assume that A fulfills (P). Then by hypothesis (ii) H\ is finite 
dimensional and there exists 77 > 0 such that 

ReA>? 7 , VA € cr+(A). (3.4) 

Moreover e tA H\ can be extended for t < 0 by the formula 

e tA n+ = ^~ [ e tx R(X 1 A) dX, t e R. 

27 ri y 7 + 

Finally, by (3.4) there exists N' A > 0 such that 

\\e tA n+\\ < N' a , W< 0. (3.5) 

□ 


Remark 3.5. Assumptions (V) are verified in each of the following cases: 

(i) 77 is finite dimensional. 

(ii) e tA is compact for any t > 0. □ 

3.3 Stabilizability 

In this section we want to give a necessary and sufficient condition in order 
that (A, 77) be stabilizable with respect to the identity 7. We first prove a 
lemma on the existence of solutions of (1.1) in [0, +00 [. 

Lemma 3.1. Assume that conditions (77)oo-(i)-(ii) are verified and moreover 
that A fulfills (V) with er°(A) = 0. Then the following statements are equiv¬ 
alent: 

(i) for allxGH, there exists «Sl 2 ([0, +oo[; U) such that x g7 2 ([0, +oo[ ; 77), 
x being the solution to (1.1) corresponding to u. 

(ii) Range 7 D II A (H), where 7 is defined by 

/»00 

u\-^^u= / e~ sA Il\Bu(s) ds : L 2 ([0, +oo[; U) —> H, 

Jo 
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(iii) the mapping 

7*£ = B*(n+ye- ASTAR £: H -> L\\ 0, +oo[ ; U), 


is one-to-one, 

(iv) for all A G a + (A*), Ker(B*) n Ker(A — A*) = {0}. 

Proof. Let u € L 2 ([0, +oo[ ;£/), and let x be the solution to (1.1). Then we 
have t 

x(t) = e tA x o+ f e^~ AA Bu(s) ds = X-(t) + x+(t), 

Jo 

where 


rz r i-oo 

x-(t) = e tA IIf i xo + / e ( - t ~ s ^ A II^Bu(s) ds — / e^ t ~ s J A n\Bu{s) ds, 

Jo Jt 

x + {t) = e tA \\Il\xo + I e~ sA Il\Bu{s) g?s| . 


Remark that X- G L 2 (0, oo; H) by ('P)-(ii) and (3.5), whereas x + G L 2 (0, oo; H) 
if and only if 

r+oo 

n\x o + / e~ sA n\Bu{s) ds = 0. 

Jo 

It follows that (i) 4=4- (ii). Moreover as the space Il\(H) is finite dimen¬ 
sional, (ii) 4=4- (iii) by the Alternative Principle. Thus it remains to show 
that (iii) 4=4- (iv). Assume (iii) and, by contradiction, that (iv) does not 
hold. Then there exist A G er + (A*) and f G different from 0 such 

that B*f — 0, A£ = = 0. Then e~ sA f = e~ Xs f and we have 

B*e~ sA * {nX)*f = 0, s > 0, (3.6) 


which is a contradiction. 

(iv) =4- (iii). Assume (iv) and, by contradiction, that (iii) does not hold. 
Then there exists £ G (n^(H))* different from 0 such that (3.6) holds. By 
differentiating (3.6) several times with respect to s and by setting s = 0 we 
see that 

p(A*)£ = 0 

for all polynomials p. Choose p as the minimal degree polynomial such that 
p(A*)f = 0. Let Ao be a root of p; then clearly Ao G a + (A*). Set 

hW = and ^ = 

A — Ao 

then by (3.6) it follows that if G Ker(!?*) fl Ker(A/ — A*), which is a contra¬ 
diction. □ 

The following result is a straightforward generalization of a result due to 
M. L. J. Hautus [2], 
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Proposition 3.3. Assume that conditions (7Y)oo-(i)-(ii) and ( V) are verified. 
Then the following statements are equivalent: 

(i) ( A , B ) is stabilizable with respect to I, 

(ii) Ker(A - A*) n Ker(B*) = {0}, VA G a 0 (A) U a + {A). 

Proof We can clearly choose £ > 0 such that, setting A s = A + el, then 
a°(A e ) is empty, so that we can apply Lemma 3.1. Setting v(t) = e et u(t), 
z(t) = e £t x(t), problem (1.1) becomes 

z'(t) = A e z(t) + Bv(t), ^(O) = x. 

Now assume that (ii) holds. By Lemma 3.1, for all Xo G H , there exists 
v G L 2 ([ 0, 00[; U) such that z G L 2 (0, 00; //); thus {A, B) is /-stabilizable and 
(i) holds. 

It remains to prove that (i) => (ii). In fact assume (i) and that, by 
contradiction, (ii) does not hold. Then there exists A G a°(A*) Uct + (A*) and 
f G D(A *) different from 0 such that 


B*t; = 0, A£ - A*f = 0. 


(3.7) 


Choose now x G H such that (xo,£) = 1; by the hypothesis (i) there exists 
u G L 2 (0,00; U) such that x G L 2 (0,00; H). As 


( x t,£) = (%o,e tA *0 + [ (u(s), B*e tA * f) ds, 


J 0 

by (3.7) it follows that (x t ,fi) = ( Xo,e tA £) = e xt , which is a contradiction, 
because Re A > 0. The proof is complete. □ 


3.4 Exponential stability of F 

We assume here that ( A , B) is C-stabilizable and denote by F = A — BB*P£f ln 
the closed loop operator. We prove the following result. 

Proposition 3.4. Assume that (A, B ) is C-stabilizable and that A and F 
fulfill (V). Then the following statements are equivalent: 

(i) F is exponentially stable, 

(ii) for any A G u + (A) U a 0 (A), we have 

Ker (A - A I) n Ker(C') = {0}. (3.8) 

Proof, (i) =>• (ii). Assume that F is exponentially stable and, by contradic¬ 
tion, that (ii) does not hold. Then there exists Xq 0 and Ao G er + (A) such 
that 

ReAo > 0, Axq = AqXq, Cxq = 0. 


It follows that 


(3.9) 
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,, (-fmin(^)^O? ^o) — 2 Re A() (Pminit'jXg 5 Xg') \B I 

Clt 

£ 2 Re Ao (-Prnin (t)xo,Xo), 

where P m in is the minimal nonnegative solution of (2.1). As P m i n (0) = 0 by 
(3.9), it follows that P m in(t)£o = 0 and then P^? n a;o = 0. Thus 

Fx o = Ax o - BB*P™ in x o = Ax 0 = Xx 0 , 

which contradicts the fact that F be exponentially stable. 

(ii) =4> (i) Assume now that (3.8) holds and, by contradiction, that P is 
not exponentially stable. Then there exists Ag € C and Xg ^ 0 in H such that 


Fx 0 = AgXg, RcAo > 0. 


Because, as easily checked, P™ in verifies 


rp-k poo 
r min 


+ P“ F - 

1 min 


P™ n BB*P™ n + C*C = 0, 


we have 

2 Re Ao (P^ in Xg , Xg ) + \B*P™ in Xg \ 2 + \Cxg \ 2 = 0, 

which implies B*Ppf in Xg = 0, Axg = AoZo> and Cxg = 0, and this fact contra¬ 
dicts (ii). □ 

We now give a characterization for the stability of P. 

Proposition 3.5. Assume that the conditions of Proposition 3.4 are verified. 
Then the following statements are equivalent: 

(i) P is exponentially stable, 

(ii) (A, C) is detectable. 

Proof, (i) => (ii). If P is exponentially stable, then, by Proposition 3.4, (3.8) 
holds. But this implies that (A*,C*) is stabilizable with respect to I (by 
Proposition 3.3). Thus (ii) is proved. The implication (i) => (ii) was proved 
in Proposition 3.4. □ 


4 Qualitative properties of the solutions of the Riccati 
equation 

In this section we assume that conditions (fH)oo are verified and that (A, B) 
is stabilizable with respect to C. We again consider the equations 

P'= A*P + PA-PBB*P+ C*C, (4.1) 

A*X + XA - XBB*X + C*C = 0, (4.2) 

and denote by P m ; n and Ppf in the minimal solutions of (4.1) and (4.2), respec¬ 
tively. We say that a solution X € X + (F[) of (4.2) is maximal if 
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V solution Y £ E + (H) of (4.2) => Y < X. 

If a maximal solution exists, it is clearly unique; however a maximal solution 
does not exist in general (see Remark 4.2 below). The existence of a maximal 
solution under suitable assumptions will be proved in §4.3. 


4.1 Local stability results 

We study here the exponential stability of any positive solution X of (4.2). 
This property of X is naturally related to the exponential stability of the 
linear operator A — BB*X. 

Proposition 4.1. Let X £ E + (H) be a solution of (4.2). Assume that A — 
BB*X = K is exponentially stable, that is, that there exist a > 0, N > 0 such 
that 

\\e tK \\ < Ne~ at , t > 0. (4.3) 

Then there exist r > 0 and a > 0 such that, if Pq £ X + (H) and ||Po — -T|| < 
1/2 rN 2 , we have 

\\P(t)-X\\<re- at , t> 0, 

where P is the mild solution to (4.1) such that P(0) = Pq. 

Proof. Set Y(f) = P(t ) — X; then Y is the mild solution to the problem 

Y' = K*Y + YK — YBB*Y, Y(0) = P 0 - X = Y 0 , (4.4) 

which is equivalent to the equation y(Y) = Y, where 7 is defined by 

7 (Y)(t)x = e tK *Y 0 e tK x- [ e {t - s)Kt Y{s)e {t - s)K xds, (4.5) 

Jo 

for any x G H. For any a > 0 we introduce the Banach space 

C a ([0,oo[ ;£(#)) = {re Cs([0,oo[;E(H))-. sup \\e ta Y(t)\\ < oo}, 


and, for any r > 0 we set 

B r = {Y£ C'„([0,oo[ : ||Y|| a < r}. 

We now want to solve (4.4) by proving that 7 has a fixed point in B r , for a 
suitable r. If Y, Z £ B r we have, taking into account (4.3), 

/V 2 r 2 

|| 7 (r)|| o <Ar 2 ||Y 0 || + —||B|| 2 

v N 2 

II#) - 7#)IU < N 2 \\Y 0 \\ + 2— \\B\\ 2 \\Y - Z ||. 

Now choose r such that 


rN 2 9 1 

2 — l|B » 


IBII 2 < 


and then Yq such that ||To|| < p/2N 2 . Then 7 is a contraction on B r and the 
conclusion holds. □ 
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4.2 Attractivity properties of a stationary solution 

We first show that the minimal solution Pfff in is globally attractive from below. 

Proposition 4.2. Let Po G E + (H) such that Pq < P£f in and let P be the 
mild solution of (4.1) with P( 0 ) = Pq. Then we have 

lim P{t)x = P^ n x, \/x G H. 

t—> OO 

Proof. By Proposition 2.2 we have 

Pmin(t) < P(t) ^min) 

so that 


0 < (Pmin X - P{t)x, x) < (P^inX ~ Pmin{t)x, x) , X G H, 
and by (2.7) 

lim (P“ \ n x — P(t)x, x) = 0, x G H, 

t—> OO 

which implies the conclusion. □ 

We now consider a general positive solution X of (4.2) and set K = A — 
BB*X. We first show that if K is exponentially stable, then X is globally 
attractive from above. 

Proposition 4.3. Let X G X + {H) be a solution of (4.2), and assume that 
K = A — BB*X is exponentially stable and that (4.3) holds. Then for any 
Po > X we have 


||P(t)-A|| < A 2 e- 2at ||P 0 -X||, t> 0, (4.6) 

where P is the solution to (4.1) such that P( 0) = Po- 

Proof. Set Y = P(t ) — X; as Po > X, we have, by Proposition 2.2 in Part IV, 
Chapter 1, Y(t) > 0. Moreover Y is the mild solution to problem (4.4). For 
any x G D(A) we have (using the fact that Y is a strict solution of (4.4)) 

-7-( Y(t — s)e sK x , e sK x) = | B*Y(t — s)e sK x | 2 , \/x G D(A) 

ds 

so that (because D{A) is dense in H ) 

(Y(t)x,x)+ I \BY(t — s)e sK x\ 2 ds = (Y(0)e sK x, e sK x), \/x G H. 

Jo 

It follows that 


(. P(t)x — Xx, x) < (Y ( 0)e sK x , e sK x), Vx G H, 


which yields (4.6). 


□ 
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The following result shows that if X is a positive solution of (4.2) such 
that K = A — BB*X is exponentially stable, then X is maximal. 

Proposition 4.4. LetX,Y G S + (H) be solutions of (4.2). A ssume that K = 
A — BB*X is exponentially stable. Then X > Y. 

Proof. Set Z = X — Y; by (4.4) it follows that 

(Zx, Kx) + (ZKx, x) + (ZBB*Zx , x) =0, Mx G D(A), 
which implies that 

^( Ze sK x,e sK x ) = -\B STAR Ze sK x\ 2 , Vx G D(A). 

As D(A) is dense in H , by integrating this between 0 and t, we obtain 

(Zx, x) = (Ze tK x , e tK x ) + f \B* Ze sK x\ 2 ds 

Jo 

> (Ze tK x,e tK x), Vx G H. 

As t —> oo we have (Zx, x) > 0, \/x G H so that X > Y. □ 

Corollary 4.1. Equation (4.2) has at most one positive solution X such that 
A — BB*X is exponentially stable. 

Proof. Let X, Y G E + (H) be two solutions of (4.2) such that A — BB*X and 
A — BB*Y are exponentially stable. By Proposition 4.4 it follows that X > Y 
and Y > X so that X = Y . □ 

Concerning the minimal solution P£fi n we have a uniqueness result. 

Corollary 4.2. If A — BB*P£f in is exponentially stable, then P^? n is the 
unique positive solution of (4.2). 

Proof. It is sufficient to observe that is both the maximal and the mini¬ 
mal solution of (4.2). □ 

We show now that if F = A — BB*P£f in is exponentially stable, then P^ in is 
globally attractive among all the positive solutions of (4.2). In finite dimension 
this result is well known; see W. M. WONHAM [2]. 

Proposition 4.5. If F = A — BB*P£f in is exponentially stable, then for any 
P 0 G X+(H) we have 

lim P(t)x = P£f in x, \/x G H , 

t—> OO 

where P is the mild solution of (4.1) such that P( 0) = Pq. 


(4.7) 
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Proof. Choose n € N such that Pq < nl , P^f in < nl. Then by Proposition 2.2 
in Part IV, Chapter 1, we have 


Vii i n (t) < P(t) < Q(t), 


(4.8) 


where Q is the mild solution of (4.1) such that Q(0) = nl. Now, as t —> oo, 
Pmin(t)x -> P™ in x and, by (4.6), Q(t)x -> n x; this, along with (4.8), 
implies (4.7). □ 


Remark 4.1. By Proposition 3.5 we know that if ( A , C ) is detectable, then the 
feedback operator F is exponentially stable. Thus, by Corollary 4.2, P£f ln is 
the unique nonnegative solution to (4.2). However, detectability of (A,C) is 
not necessary for the uniqueness, as the following example shows. Let H = 
U = Y = R 2 , 


A = 


0 1 

00 ’ 


B = I, C = 0; 


as easily seen X = 0 is the unique solution of (4.2), but the feedback operator 
F = A is not stable and (A, C) is not detectable. 

When H is finite dimensional, M. Sorine [2] has shown that the following 
conditions are sufficient for the uniqueness of the solution: 


(i) (A, B) is C-stabilizable, 

(ii) (A*,C*) is l?*-stabilizable, 

(iii) no eigenvalue of the closed loop operator F lies on the imaginary axis. 

This result can be easily generalized to any Hilbert space H provided that A 
and F fulfill assumptions (V) of §3.2. □ 


4.3 Maximal solutions 

We assume here, beside (H)oo, that {A,B) is /-stabilizable (which, obvi¬ 
ously, is stronger than assuming that (H, B) is C-stabilizable). We follow here 
A. Bensoussan [1], 

For any e > 0, we consider the problem: To minimize 

POO 

Je(u) = / {|Cx(s)| 2 + e|a;(s)| 2 + |ii(s)| 2 } ds, (4.9) 

J 0 

over all controls u £ L 2 ( 0, oo; U) subject to the differential equation constraint 
(1.1). Consider the observation D e = \/C*C + el (the observation space being 
H). Clearly (A,B) is _D e -stabilizable, so that, by Theorem 3.1, there exists a 
unique optimal pair (it e , x s ) and a solution P £ of the algebraic Riccati equation 

A*X + XA - XBB*X + C*C + el = 0, (4.10) 


such that 
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x' e = {A - BB*P £ )x, 

x £ (0) = x 0 , (4.11) 

u e = -B*P e x e . 

Moreover (A, D e ) is detectable (because D e is invertible and Dj 1 £ C(H)). 
Thus by Corollary 4.2, P e is the unique solution in E + (H) of (4.10). Moreover, 
by Proposition 4.5, given Q £ S + {H) we have 

lim Pn(t) = P £ x, \/x € H, (4-12) 

t —>-oo 

where Pq is the mild solution of the Riccati equation 

P' = A*P + PA- PBB*P + C*C + e/, P(0) = Q; 

that is, P £ is globally attractive. 

Proposition 4.6. Assume that conditions (7t)oo are verified and that (A,B) 
is I-stabilizable. Then (4.2) has a maximal solution P^ ax - Moreover 

lim P £ x = P ^' x, \/x £ H. (4-13) 

£—^0 

Proof. We first remark that, as {P £ } is nonincreasing (by Proposition 2.2 in 
Part II, Chapter 1) and bounded below by 0, the limit 

lim P £ x = Vx £ H , (4-14) 

£—►0 

exists. We have to show that P^ ax the required maximal solution. 

Step 1. 

Pjyf ax is a solution to(4.2). 

In fact for all x, y £ D(A), we have 

(P £ Ax, y) + (P e x, Ay) - ( B*P £ x , B*P e x) + ( Cx , Cy) + e(x, y) = 0; 

letting £ tend to 0 and using (4.14) we see that P^ ax a solution of (4.2). 

Step 2. 

-^Max i s maximal. 

Let Q be any solution of (4.2); then, by Proposition 2.2 in Part II, Chapter 1, 
we have Pg(f) > Q (where Pq is the solution to (4.9)). Thus, by (4.12) and 
(4.14) it follows that P^ax > Qi so that P^ax i s maximal. □ 

We will now give the variational interpretation of the maximal solution. 
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Theorem 4.1. Assume (H)and that ( A,B) is I-stabilizable. Let Pff ax be 
the maximal solution of (4.2) and let xo G H. Then 

(^Max^’o^’o) = inf{ Joo(w): u G i 2 (0, oo;U),x G L 2 (0, oo; H)}, (4.15) 

where ( x,u ) are subject to the differential equation constraint (1.1). Moreover 

( P Max x O,X 0 ) > Joo(u), (4.16) 


where u = lim e ^o u e and u e is defined by (4.11). 
Proof. Set 


U ad = inf{ J oc (u): u G L 2 (0, oo; U), x G L 2 (0, oo; H)}, 


where x is the solution of (1.1). 

We first remark that, recalling (4.13) and arguing as we did in the proof 
of Lennna 2.1, we can show that the following limits: 

x(t) = lim x e (t), u(t) = lim u e (t), t> 0 (4-17) 

£—^0 £—^0 

exist and are uniform on the bounded subsets of [0, oo[. Let now u G U ad - By 
identity (6.2) in Chapter 1 of Part IV, we have 


(P^X 0 ,X 0 )+ [ {|ti(s) + B*Pff ax x(s)\ 2 }ds 
J 0 

= / {IC7a:(s)| 2 + |w(s)| 2 } ds + (Pff ax x(t), x(t)). 

Jo 

As x G L 2 (0,oo; 1L), there exists a sequence t n /* oo such that x(t n ) —* 0. 
Therefore 


(-^Max^O 


Xo) + f 

Jo 


|u(s) + B*P{£ ax x(s) I 2 ds = Joo(w), 


(4.18) 


which implies that 


(P^x 0 ,x 0 ) < 

Jo O (u), Vu G U ad . 


Letting e tend to zero in the equality 

(P e X 0 ,X 0 ) = Joo(u e ) + e ||IIZ/ 2 (0,00;^/), 

one obtains (4.16); also, as u e G U ad , the conclusion follows. □ 

Proposition 4.7. Under the conditions of Theorem 4.1, the following state¬ 
ments are equivalent. 

(i) The operator Fm = A — BB*Pff ax is exponentially stable. 
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(ii) (-P]Yf ax £o> ^o) = min{ u £ L 2 (Q,oo\U),x € P 2 (0, 00 ; if)}, where x 

is given by (1.1). 

Proof, (i) ==£■ (ii). Let x{t) and u(t ) be defined by (4.17). If Fm is exponen¬ 
tially stable, we have x € L 2 (0,oo; H) so that u € U a d and (ii) holds. 

(ii) => (i). Let u* € P 2 (0, 00 ; U) such that the corresponding solution x* 
of (1.1) belongs to P 2 (0, 00 ; H). Setting u = u* in (4.18), we obtain 

/»oo 

/ \u*(s) + B*P^ ax x*( S )\ 2 ds = 0 

Jo 

which implies that 

X*(t) = e tFM xo, u*(t) = -B*P^ ax e tF ^x 0 , 

and the conclusion follows from Datko’s Theorem. □ 

Corollary 4.3. Assume that the conditions ( TL)oo are verified and that (A,B) 
is I-stabilizable. Let P“■„ and P^ ax be the minimal and maximal solutions of 
the algebraic Riccati equation. Then 

til P°° < P°° 

lb -Cnin — r Max> 

(ii) P£? n is globally attractive from below, 

(iii) -P]yf ax is globally attractive from above. 

Proof, (i) is clear, (ii) follows from Proposition 4.2, and (iii) follows from 
Theorem 4.1 and Proposition 4.3. □ 

Remark 4.2. 

(i) The maximal solution does not exist in general. Let in fact 

H = U = Y = R 2 , A= , 5 = 0, (7 = 0. 

Then (4.2) reduces to A*X + XA = 0 and X = XI is a solution for all 
A > 0. 

(ii) In (4.15) the infimum is not a minimum in general. In fact, let A = 0, 

U = H, B = 7, and (7 = 0. Then the algebraic Riccati equation reduces 
to P 2 = 0 and one has P^ in = Pm^x = 0- Thus the infimum in (4.15) is 
0; however the control u = 0 does not belong to U a d if xq ^ 0. Remark 
also that Pm is not exponentially stable. □ 

Remark 4.3. For the existence of the maximal solution it is not necessary that 
{A, B) be /-stabilizable. It is sufficient to assume that there exists D > ( 7*(7 
such that 

(i) (. A , B) is D 1 / 2 -stabilizable. 

(ii) (A, D 1 / 2 ) is detectable. 


In fact, under these assumptions, one can easily repeat the previous argu¬ 
ments. □ 



4 Qualitative properties of the solutions of the Riccati equation 501 

4.4 Continuous dependence of stationary solutions with respect to 
the data 


We consider here a sequence of Riccati equations 

p,k = KPk + PkAk - P k B k B* k P k + C* k C k , 
A* k X k + X k A k - X k B k B* k X k + C* k C k = 0. 


Assume that hypotheses (2.18) in Chapter 1 of Part IV are verified and set 

pOO 

JL( U ) = / {\CkX k (s)\ 2 + \u(s)\ 2 }ds, uGL 2 (0,oo;[/), 

Jo 

where x k is the mild solution of the system 

x' k = A k x k + B k u, Xfc(0) = x k0 . (4.20) 

We say that (A k ,B k ) is stabilizable with respect to C k uniformly in k, if for 
any x$ € H , there exists u £ L 2 ( 0, oo; U) such that 

j£» <oo, Vfc £ N. (4.21) 


If this assumption is verified, then, according to Theorem 3.1, the minimal 
solution of (2.2) exists. We denote it by P^ min - Finally we set 

F k =A k - B k B* k P£> min . 

We now prove the following theorem (see also J. S. Gibson [1]). 

Theorem 4.2. Assume that assumptions (2.18) in Chapter 1 of Part IV are 
verified and that (A kl B k ) is stabilizable with respect to C k uniformly in k. If, 
in addition, there exist N > 0 and a > 0 such that 

\\e tFk \\ < Ne~ at , t> 0, (4.22) 

then we have 

lim Pk% in x = P™ n x, \/x £ H. 

K—>00 

Proof. We have 

poo 

{ P k%inX0,X 0 ) < / {Ms)| 2 + |u(s)| 2 }c?S, 

do 

where x k is the solution of (4.20). Choose u such that (4.21) holds; then, by 
using the Uniform Boundedness Theorem, it is easy to show that there exists 
c > 0 such that 

P fc “ min < cl, Vfc £ N. (4.23) 

Now set V k = Q k - P“ min (resp. V = Q - PjP) where Q k (resp. Q) is the 
solution of (4.19) (resp. (4.1)) such that Qfc(O) = cl (resp. Q( 0) = cl). Then 
14 is the mild solution of the problem 
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Vi = F £\4 + V k F k - V k B k B* k V k , 14(0) = cl - Pff min . 


Remark that 14(0) > 0 in virtue of (4.23). By (4.22) it follows that 
||Vfc(t)|| < N 2 e~ 2at , t> 0. 


Moreover 


I poo _ poo I < I p< 

I- 1 min a ' ± fc,min a 'l — ^ min 


x—Q(t)x\ + \Q(t)x - Q k (t)x\ + \P^ min x~Qk(t)x\ 
< 2cN 2 e~ 2at \x\ + | Q(t)x - Q k (t)x\, 


and the result follows from Theorem 2.2 of Chapter 1 (Part IV). 


□ 


4.5 Periodic solutions of the Riccati equation 

In this section we study periodic solutions of Riccati equations. For the finite 
dimensional case, see M. A. Shayman [1], Here we follow G. Da Prato [2,3]. 

Let T > 0 be fixed. We say that P € C S (R; B(H)) is a T-periodic solution 
of the Riccati equation 


P' = A*P + PA- PBB*P + C*C, (4.24) 

if 

(i) P(t + T) = P(t), VteR. 

(ii) P is a mild solution of (4.24); that is, for any t,s £ I with t < s we 
have 

P(t)x = e^~ s)A * P{s)e^~ s)A x + j e {t ~ T)A *C'Ce^-^xdr 

e it - T ) A *P( T ) BB *P( T ) e {t -T )A x dT . 

If, in addition, P is not constant we say that P is a nontrivial periodic solution 
of (4.24). 

Proposition 4.8. Assume that (7Y)oo is verified, then the following state¬ 
ments are equivalent: 

(i) ( A , B ) is C-stabilizable, 

(ii) there exists a positive T-periodic solution (possibly trivial) of (4.24). 

Proof, (i) => (ii) follows from Proposition 2.3 because any stationary solution 
is also periodic. 

(ii) =4> (i). Assume, by contradiction, that there exists a T-periodic solu¬ 
tion of (4.24) whereas (i) does not hold. Then, by Proposition 2.2, there exists 
Xo € H such that (P m in(t)xo, xo) —> oo as t —» oo, where P m in( - ) is the mini¬ 
mal positive solution of (4.24). As P(t) > P m in(t) we have (P(t)xo,Xo) —> oo 
as t —> oo, which is a contradiction because P is periodic. □ 
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Lemma 4.1. Assume that (A, B) is C-stabilizable and let P be a positive T- 
periodic solution of (4.24). Then we have P(t) > Pf£ m , where P£% n is the 
minimal solution of (2.2). If, in addition, ( A, B ) is I-stabilizable we have 

m < p^ ax . 

Proof. For the first statement, it is sufficient to let n tend to infinity in the 
inequality 

P(t) = P{t + nT) > 

P min (t + nT), 

whereas the second one follows from Corollary 4.3. □ 

Let now P be a positive T-periodic solution of (4.24) and set Q = P — P£f ln 
and F = A — BB*P£f in . By Lemma 4.1 we have Q > 0; moreover, as easily 
checked, Q is the mild solution of (4.24) such that Q(0) = P{ 0) — P^ in = Qo ; 
that is 

f Q' = F*Q + QF- QBB*Q, 

1 Q(0) = P( 0) - P™ n = Qo- 


Problem (4.25) can be explicitly solved; we could use formula (2.22) in Part IV, 
Chapter 1, but we prefer to give a simpler proof in the following lemma. 


Lemma 4.2. The solution of problem (4.25) is given by the formula 
Q(t) = e tF * Qo(I + flit)Qo)~ 1 e tF , 


(4.26) 


f t(t)x = f e sF BB*e sF xds, 

Jo 


x € H. 


Proof. First of all we remark that formula (4.26) is meaningful because Q(f) £ 
F{H) so that the inverse of I + Q(f)Qo belongs to C{H) (see Proposition 1.1 
in Appendix A). Now let Q n be the solution to the approximating problem 

Q' n = FnQn + QnF n — Q n BB*Q n , Qn(0) = Qo H—/, 

n 

where F n are the Yosida approximation of F. Setting V n = Q„, this problem 
reduces to the following linear one: 


Vf = -F n V n - V n F* + BB* V„(0) = f Qo + -I 


Thus we have 


V n {t) = e~ tFn ^Qo + e~ tF J + J e (t ' 8)F ”BB*e (t " s)f “ ds 


I + / e sF "BB*e sF ” dsQ 0 + -I} (Qo + -I 
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which implies that 


Qn (t) — e 


tF* 


Q o 4 —I 
n 


I 


n sF„ 


BB*e 


* „sF* 


dsQo d - —I 
n 


-l 


„tF n 


Now the conclusion follows from Theorem 2.1 of Chapter 1 in Part IV. 
From Lemma 4.1 we have the following result. 


□ 


Proposition 4.9. Assume that the conditions (7t)oc ore verified and that 
( A,B) is stabilizable with respect to C. Let Pq > P^ in and let P be the so¬ 
lution of (4.24) such that P(0) = Pq. Then P is T-periodic if and only if 
X = Pq — P£f ln verifies the equation 

e TF * X(I + Ll(T)X)~ 1 e TF = X, (4.27) 


where 


and 


n(T)x= f e sF BB*e sF *xds, x € H, 

Jo 

F = A-BB*P™ n . 


We will now study a special case of (4.27). We remark that it is also 
important to decide whether a given solution of (4.27) is a nontrivial periodic 
solution. Assume that 


(i) A = £)+-/, C = 0, a > 0, 

(ii) D + D*= 0, e 2nD = /, || 

(iii) there exists S > 0 such that 


e tD \\ < 1, 


(4.28) 


/ e as e sD BB*e sD * ds > S. 

Jo 

Then (4.27) is equivalent to 

e 2na x(i + nxy 1 = X, 


(4.29) 


where 


p27T 


Q = 0(2tt) = / e“ s e sI) BB*e 5D * ds 


and the Riccati equation (4.24) becomes 

P' = D*P + PD + aP — PBB*P. 


(4.30) 


Proposition 4.10. Assume that the hypotheses of Proposition 4.9 hold and 
that, in addition, the conditions (4.28) are verified. Then all solutions of 
(4.29) are given by the formula 

x = ( e 2 ™ - i)n~ 1/2 sn~ 1/2 , 

where E is any hermitian projector operator in E + (H). 
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Proof. Equation (4.29) is equivalent to (e 2 ™ — 1)X = XflX and setting 
Y = fl^ATI 1 / 2 to (e 2va — 1 )Y = Y 2 ; thus the conclusion follows. □ 

Let X be a solution of (4.29) and let P be the solution of (4.30) such 
that P{ 0) = X; P is 27r-periodic. We now want to see if P is nontrivial. Let 
us consider the special case when B = I. In this case we have X = aS and 
moreover 

P(t) = ae at e tD *E[I + {e at - l)E]~ 1 e tD . 

As E is a projector we have E(I + bE)~ 2 = (1 + b)~ 1 E for any b > 0, so that 

P(t) = ae tD * Ee tD . 

Thus, if E = 0 or /, P(t) is constant, whereas if E is different from 0 or /, 
P(t) is not trivial. □ 

Remark 4.4 (Unbounded observation operator). Assume here that (7too) _ (i) _ 
(ii) and (Woo)-(v) are verified and consider the optimal control (1.1)-(1.2). 
Obviously, in the definition of the cost functional Joo, Cx must be defined as 
in §6 of Chapter 1 of Part IV. The definitions of optimal pair, stabilizability, 
and weak and stationary solutions (but not strict solutions) of the Riccati 
equation are now the same as before. However several of the previous results 
can be generalized, with the exception of strict solutions of the algebraic 
Riccati equation and of the detectability, because it is related to the dual 
system, which has an unbounded control operator. □ 


5 Some generalizations and complements 


5.1 Nonhomogeneous state equation 


We consider, as in §7 of Chapter 1 in Part IV, a system governed by a non¬ 
homogeneous state equation and the following infinite horizon problem: To 
minimize 

nOO 

Jooiu) = / {|Cx(s)| 2 + |u(s)| 2 }ds, (5.1) 

Jo 

over all controls u G L 2 ( 0, oo; U) subject to the differential equation constraint 
x'(t) = Ax(t ) + f(t) + Bu(t ), t> 0, x(0) = xq- (5.2) 


We assume that 

f « f GL 2 (0,oo;H), 

I (ii) hypotheses (H) hold, 

I (iii) ( A , B) is C-stabilizable, 

[ (vi) F = A — BB*P((( in is exponentially stable. 


Under conditions (5.3) it is easy to check that the following problem: 
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r'{t) + F*r(t) + P™ in f(t ) =0, t > 0, r(oo) = 0 
has a unique mild solution given by 

/ OO 

e ( S -t)F*pooj( s ) dfj 

We can now prove the following result. 

Lemma 5.1. Assume (5.3) and let Xq £ H and u G L 2 (0,oo;[/); then we 
have 


/»oo 

dooCu) = (-P^n^o^o) + 2(r(0),x 0 ) + / |2(r(s), /(s)) - \B*r(s)\ 2 } ds 

Jo 

roo 

+ / \u(s) + B*r{s) + B*P™ in x(s)\ 2 ds. 

Jo 

Proof. It is sufficient to set P = P m in (the minimal solution of the Riccati 
equation) in (7.4) in Chapter 1 of Part IV, and to let T tend to infinity. □ 
Now the following result is easily proved. 

Theorem 5.1. Assume (5.3) and let x$ £ H. Then there exists a unique op¬ 
timal pair (u*,x*) for problem (5.1)-(5.2). Moreover the following statements 
hold. 

(i) x* is the mild solution to the closed loop equation 

ix’{t) = [A — BB*P£jx(t) - BB*r(t) + f(t ), t > 0, 

|a:(0) = x 0 . 

(ii) u* is given by the feedback formula 

u*(t) = -B*[P£ n x*(t)+r(t)}. 

(iii) The optimal cost is given by 

nOO 

Joc(u) = (P™ in x o ,x o ) + 2(r(0),x o )+ / {2(r(s),/(s)) - |P*r(s)| 2 } ds. 

Jo 

Remark 5.1. If / ^ L 2 (0,oo; H) it can happen that no admissible control 
exists. Consider in fact the following example. Let H = U = Y = C, T = 0, 
B = C = 1, and / = 1. It is readily seen that 


Joo(u) = J | t + J u ( s ) ds 


+ \u(t)\ 2 > dt. = oo. 


In this case the following cost function seems more appropriate (see G. Da 
Prato and A. Ichikawa [4]): 

1 f T 

Joo(u) = limsup — / {|Ca:(s)| 2 + |u(s)| 2 }cis. □ 

T—>oo J Jo 
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5.2 Time-dependent state equation and cost function 


We consider here the system 

\x'{t) = A(t)x(t) + B(t)u(t), t> 0, 

|x(0)=x 0 , 

where Aft) : D(A(t)) C H —> H, t > 0 and B(t) £ £(U;H ), t> 0, are linear 
operators. We assume that condition (7.8) in Chapter 1 of Part IV is verified. 

We want to minimize the cost function 

/»00 

J 00 {u)=\ {|C(s)x(s)| 2 + |w(s)| 2 } ds 

Jo 

over all controls u £ L 2 { 0, oo; U) subject to the differential equation constraint 
(5 ' 4) - 

The definitions of admissible controls and optimal pair are the same as 
before. Also when, for any Xq £ H , an admissible control exists, we say that 
(A, B) is C-stabilizable (cf. Definition 2.1). In the autonomous case this prob¬ 
lem was studied with the tool of the minimal positive solution of the algebraic 
Riccati equation. Now the same role is played by the minimal positive bounded 
solution of the Riccati equation 

Q' + A*Q + QA- QBB*Q + C*C = 0 (5.5) 

in [0, +oo [. In the remaining of this subsection we follow G. Da Prato and 
A. Ichikawa [4], 

Definition 5.1. We say that Q £ C s ([0, +oo[ \S + (H)) is a (mild) solution 
to (5.5), if for any a > 0, t G [0, a] and x G H, we have 

Q(t)x = U* (a,t)Q(a)U(a,t)x + U*(s,t)C*(s)C(s)U(s,t)xds 

— ^ U*(s,t)Q(s)B(s)B*(s)Q(s)U(s,t)x ds. □ 

Theorem 5.2. Assume that conditions (7.8) and (7.9) in Chapter 1 of 
Part IV are verified, and that ( A , B ) is C-stabilizable. Then (5.5) has a non¬ 
negative bounded solution Q. This solution is minimal among all nonnegative 
bounded solutions of (5.5). 

Proof. For any A > 0 and n > 0 sufficiently large, we introduce the Riccati 
equations 

l +a * qX + qXa ~ qXbb * qX + c * c = °. ( 56 ) 

\q A (A) =0, t G [0, A], 


+ KQn + QnAn - Q„BB*Q^ + C*C = 0, 
QnW = 0; t G [0, A], 
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where A n are the Yosida approximations of A. By Theorem 7.2 of Chap¬ 
ter I of Part IV, problems (5.6) and (5.7) have unique solutions Q x and Q x , 
respectively, and moreover for any x £ H 

lim Q x [t)x = Q x (t)x, (5.8) 

n—> oo 

uniformly in t € [0, A]. Also, by Proposition 7.1 of Chapter 1 of Part IV, 

Qn(t) < t G [0, A] if [i > A. (5.9) 

We now prove that there exists C\ > 0 such that 

||<2 A (t)|| < Cl, VA >0, Vf G [0, A]. (5.10) 

For this it is sufficient to prove that 

||Q A (t)|| < C u VA > 0, Vt G [0, A], Vn > 0. (5.11) 

Let x G H and let u G L 2 ( 0, oo; U) such that Joo(u) < +oo. Let moreover x n 
be the solution of the initial value problem: 

x n A n Xti -I - Bu, x^(0) x. 

Then we have 

Q x {t)x n (t),x n (t )) = \u(t) + B*(t)Q x (t)x n (t)\ 2 - \C{t)x n (t)\ 2 - \u(t)\ 2 . 
Integrating this from t and A, we find 

(Q x (t)x,x) < J {|C'(s)a:„(s)| 2 + |w(s)| 2 }(is < Const |x| 2 , 

and the ineciualities (5.10) and (5.11) follow. 

From the estimates (5.9) and (5.10) the following limit exists: 

Qoc(t)x = lim Q x (t)x, \/x G H. 

X —>-oc 

By letting A tend to infinity in the equality 

r a 

Q x (t)x = U*(a,t)Q x (a)U(a,t)x + j U*(s,t)C*(s)C(s)U(s,t)xds 

t 

U*(s,t)Q x (s)B(s)B*(s)Q x (s)U(s, t)xds, 

we see that Q ^ is a bounded solution of (5.5). It remains to prove minimality. 
Let R be a bounded nonnegative solution of (5.5). Then by Proposition 7.1 
of Chapter 1 in Part IV and the fact that Q x ( A) = 0, 

R(t)>Q x (t), Vt G [0, A], 



and so R > Q^. 


□ 
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Corollary 5.1. Assume that the conditions of Theorem 5.2 are verified and 
that, in addition, A, B, and C are r-periodic functions for some r > 0. Then 
(5.5) has a nonnegative r-periodic solution Q. This solution is minimal among 
all nonnegative r-periodic solutions of (5.5). 

Proof. Let Q^ be the minimal nonnegative bounded solution of the Riccati 
equation. Then we have 

Q\t + r) =Q x ~ T (t), Vt € [0, A — t]; 

as A —> oo, we find that Qoo is r-periodic. □ 

Remark 5.2. This result was proved in G. Da Prato and A. Ichikawa [3]. 
If A, B , C are almost periodic and H is a finite dimensional space, then Q ^ 
is almost periodic (see T. MOROZAN [1]). □ 


5.3 Periodic control problems 

Consider a dynamical system governed by a linear equation 

x'(t) = A(t)x(t) + f(t) + B{t)u{t) (5-12) 

with periodic coefficients /(•), A(-), B{-) of period 27 t. 

Then it is natural to consider 27r-periodic controls u. For any Banach space 
E we denote by Lg(E) the space of all 27r-periodic functions u: M. —> E that 
belong to L 2 { 0, 27r; E). 

We assume that 

(i) Conditions (7.8) and (7.9) in Chapter 1 of Part IV 
hold. 

(ii) A, B, C are 2-7T periodic. (5.13) 

(fii) f€L%{H). 

Obviously (5.12) does not necessarily have a 27r-periodic solution for any con¬ 
trol u £ L^(U). This happens when no Floquet exponent of A is equal to 
1. In such a case we say that A is nonresonant. As it is well known, this is 
equivalent to require that 1 belongs to the resolvent set of Ua{2tt, 0), where 
CAi(f, s) is the evolution operator relative to A. In this case (5.12) has a unique 
mild solution given by the formula 


PZ7T 

x(t) = U A {t, 0)[/ — Ua^i 0)] -1 / U A (2n,s)[Bu(s) + f(s)]ds 

Jo 

+ f U(t,s)[Bu(s) + f(s)]ds. 


0 
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We are interested in the general case, that is, when A is possibly resonant. 
For any u £ L#(U) we set 

A{u) = {y& L 2 # (H): y fulfills (5.12)}. (5.14) 

The control u is said to be admissible if A{u) ^ 0. The set of all admissible 
controls will be denoted by U a d- 

We want to minimize the cost function 

p2ir 

J(u,y) = / {\C(t)y(t)\ 2 + \u(t)\ 2 }dt (5.15) 

Jo 

over all u £ U a d and y £ yl(it). 

If there exist u* £ U a d and x* £ A(u*) such that 

J(u*,x*) < J(u,x), \/u £ U a d, Vx £ A(u) 

the function u * is called an optimal control and the associated state x* is 
called the optimal state. The pair (u*,x*) is called an optimal pair. 

We will study this minimization problem by using again the Dynamic 
Programming approach and by proceeding in the following steps. 

(i) We consider a periodic solution to the Riccati equation 

Q' + A*Q + QA - QBB*Q + C*C = 0. (5.16) 

(ii) We look for a periodic solution to the dual equation 

r\t) + (A - BB*Q)*r(t) + Qf{t ) = 0 (5.17) 

and to the closed loop equation 

x'(t) = {A- BB*Q)x{t) - BB*r(t) + f{t). (5.18) 

Then, we show that x is an optimal state and that u, given by 

u(t) = - B*(Qx(t ) + r(t)), (5.19) 


is an optimal control. 

Concerning the point (i), the existence of a nonnegative periodic solution of 
(5.16) was proved in Corollary 5.1 when (A, B) is C-stabilizable. The approach 
described below was introduced in G. Da Prato and A. Ichikawa [3] where 
the existence of an optimal pair was proved with the additional condition 
that (A, C ) be detectable. In fact in this case one can show that the Floquet 
exponents of the closed loop operator F = A — BB*Q have all modulus 
less than 1 and then F is nonresonant and (5.17) and (5.18) have periodic 
solutions. 

Here we do not assume detectability, but we give, following G. Da 
Prato [3], a characterization of the Floquet exponents of F with modulus 
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greater than or equal to one. In the following theorem Uf represents the evo¬ 
lution operator associated with F ( Uf is well defined because F is a bounded 
perturbation of A) and Qoo is the minimal nonnegative periodic solution of 
the Riccati equation (5.16). 

Theorem 5.3. Assume that condition (5.13) is verified and that (A, B) is C- 
stabilizable. Let Qoo be the minimal nonnegative 2n -periodic solution of Riccati 
equation (5.16) and F = A — BB*‘Q 00 . Let /a £ C such that \fi\ > 1 and let 
xo € H be different from 0. Then the following statements are equivalent. 

(i) Uf(2tt,0)x 0 = fix 0 . 

(ii) Ua{2tt, 0)®o = lix o and C(t)UA(t,0)xo = 0, for all t> 0. 

Moreover if either (i) or (ii) holds true, we have 

U F (t, 0)x 0 = U A (t, 0)x o , Vi > 0. (5.20) 

Proof, (i) => (ii). Let x$ £ H and let x be the mild solution of the problem 
x' = Fx, t> 0, a;(0) = xq, 

then the following identity holds: 

(' Qoc(t)x(t),x(t )) - (Qoo(0)a;o,xo) 

+ / {|l?*(s)Q 00 (s)a:(s)| 2 + |C(s)a;(s) 2 | ds} = 0. (5.21) 

Jo 

If xq € D(A) this follows easily by integrating the identity 

Qoo(t)x(t),x(t )) = -\B*(t)Qoo(t)x(t)\ 2 - \C{t)x(t)\ 2 

between 0 and t. For general xq, (5.21) follows by density. 

Let now Xq G H be such that Uf(2tt, 0)xo = a:(27r) = fix o with |/i| > 1. 
Then, setting t = 2n in (5.21) we find 

p2tt 

(\fi\ 2 - l)(Qoo(0)x 0 ,a;o) + / {|£*Qoo^| 2 + \Cx 2 \ds} = 0, 

Jo 

which yields 

B*(t)Qoo(t)x(t) = 0, C(t)x(t) =0, Vi > 0. 

Consequently x' = Ax, and 

x(t) = Up(t, 0)cco = U A (t, 0)xq, t > 0, 


which implies (ii). 
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(ii) =$■ (i). Given x$ G H , let y be the mild solution of the system y' = Ay , 
2/(0) = xq. Moreover let Q x be the mild solution of the Riccati equation 

Q' + A*Q + QA- QBB*Q + C*C = 0, Q(2ttA) = 0. 

Then the following identity holds: 

p2n\ />27rA 

(Q a ( 0)x o ,x o ) + \B*{s)Q x (s)x{s)\ 2 ds = \C(s)x(s) 2 \ds. (5.22) 

Jo Jo 

In fact if xo G D(A) this result readily follows by integrating the identity 

= \B*(t)Q x (t)y(t)\ 2 - \C(t)y(t)\ 2 

between 0 and 27 tA. For general xo, (5.22) follows by density. 

Let now xo be such that 

2/(27r) = U a (2tt, 0)x o = yx 0 , C(t)y(t) = 0, t > 0. 

Then, by letting A tend to infinity in (5.22) we find 

/*oo 

(Qoo(0)x 0 ,x 0 ) + / |5*(t)Qoo(t)x(t)| 2 dt = 0, 

Jo 

which implies B*(t)Q 00 (t) = 0, t > 0, so that y' = Fy and UA(t, 0 )xq = 
Up{t,0)xo and (i) holds. □ 

Remark 5.3. Assume that the spectra of 27 a(27t, 0) and C/f(27t, 0) consist only 
of eigenvalues (this is for instance the case for parabolic state equations in 
bounded domains; see Example 6.1 below). By the above theorem it follows 
that F is nonresonant if one of the following conditions holds 

(i) A is nonresonant. 

(ii) A is resonant but the following implication holds: 

x 0 G H, xo^ 0, U A {2n,0)xo = x 0 =» C{to)U A (t 0 ,0)x 0 £ 0, 
for at least one to > 0. 

For a case where the eigenvalues of U a (2tt,0) and C/f(27t, 0) have limit 
points, see G. Da Prato [7]. □ 

We can prove now the result. 

Theorem 5.4. Assume that condition (5.13) is verified, that A, B is C- 
stabilizable, and that F = A — BB*Q ao is nonresonant, where Q^o is the 
minimal nonnegative 2n-periodic solution of the Riccati equation (5.16). Then 
there exists a unique optimal pair (u*,x*) for problem (5.12)-(5.15) and the 
following conditions are satisfied: 
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(i) x* is the unique periodic solution to the closed loop equation (5.18), 

(ii) u* is given by the feedback formula 

u * (t) = -B* [Qoo (t)x* ( t ) + r* (t)], (5.23) 

where r is the unique periodic solution of (5.17), 

(iii) the optimal cost J(u*,x*) is given by 

p2n 

J(u*,x*)= {(r(t),f(t))-\B*(t)r(t)\ 2 }dt. (5.24) 

JO 

Proof. Let u G U a d and y G A(u). By computing 

f {(Qoo(t)y(t),y{t)) + 2 (r(t),f(t))} 
and by integrating between 0 and 27r, we find the identity 

r-2ir 

J(u,y) = J*+ \\R(t)\\ 2 dt, (5.25) 

Jo 

where 

p2n 

J*= / {(r{t),f(t)) - \B*{t)r{t)\ 2 } dt 

Jo 

and 

R(t) = B*(t)[Q 00 (t)y(t + r(t)} + u(t). 

We remark that the computation can be made rigorous by approximating Aft) 
by their Yosida approximations. It follows that 

\/u GUad, Vy € A(u). 

Now, let x* be the solution of (5.18) and let u* be given by (5.23). Setting in 
(5.25), u = u* and y = y* we obtain J(u*,y*) = J* so that the pair u*, y * is 
optimal. Finally uniqueness of the optimal pair is proved as in Theorem 6.1 
of Chapter 1 in Part IV. □ 

Remark 5.4. It is also possible to study almost periodic control problems (see 
G. Da Prato and A. Ichikawa [2]). □ 

6 Examples of controlled systems 

6.1 Parabolic equations 

We shall continue here the example of §8.1 in Chapter 1 of Part IV. Moreover 
we denote by {<fik} a complete set of eigenvectors of A and by {A*,} the 
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corresponding sequence of eigenvalues. We assume that {A^} is nonincreasing. 
We consider the infinite horizon control problem: To minimize 


Joo(u)= r I {\(Cx(t,-))(0\ 2 + \u(t,0\ 2 }dtdt (6.1) 

Jo Jn 


over all u £ L 2 {[ 0, oo] x U) subject to condition (1.48) of Chapter 1 in Part II. 

We have to discuss the existence of admissible controls. We consider two 
cases. 


First case. Ai < 0. 

In this case A is exponentially stable so that {A, B) is C-stabilizable. Thus 
by Theorem 3.1 and Corollary 4.2, the algebraic Riccati equation 

AP + PA- PBB*P + C*C = 0, (6.2) 

has a unique solution P)^ n = P^ ax an d the feedback operator F = A — 
BB*P%-„ is exponentially stable. 

Second case. Ai > 0, A 2 < 0. 

In this case we have a + (A*)Ua°(A*) = {Ai}; thus, by Proposition 3.3, ( A , B ) 
is /-stabilizable if and only if B*ip 1 7 ^ 0. Under this assumption (6.2) has a 
minimal and a maximal nonnegative solution. Moreover by Proposition 3.4, 
F is exponentially stable if and only if C<pi is not identically zero. It is easy 
to generalize the previous discussion when A m > 0 and A m +i < 0 for some 
to € N. 


6.2 Wave equation 


We continue here the example of §8.2 in Chapter 1 of Part IV. Consider the 
infinite horizon problem: To minimize 


>( u ) = [ [ {| V U C (M))| 

Jo Jn l 


+ 




KC£)II 2 j dtd£, 


(6.3) 


over all u £ L 2 ([0,oo] x Q) subject to (8.2) in Chapter 1 of Part IV. In this 
case the algebraic Riccati equation reads as follows: 


0 -1 

A 0 


X + X 


0 1 
—A 0 


- V 


0 0 
0 1 


X- 


1 0 
0 1 


= 0 . 


We prove now that ( A , B ) is /-stabilizable; for this it is sufficient to show that 
A — 2 aBB* is exponentially stable if 0 < a 2 < Ao where Ao is the principal 
eigenvalue of the Laplace operator in U, with Dirichlet boundary conditions. 
By a direct computation we find 



6 Examples of controlled systems 515 


e t(A-2aBB*) __ e -at 


cos (Et) + — sin (Et) 
E 


— sin (Et) 


a 2 +E 2 
E 


sin (Et) ——sin (Et) + cos (Et) 
jb 


where E = \JA — a 2 1. As (A, C) = (A, I) is detectable, the Riccati equation 
has a unique nonnegative solution 


poo _ poo _ 
^min 1 Max 


-Pll Pi 2 
P21 P 22 


Then, by Theorem 3A, there exists a unique optimal pair (u*,x*) with 

- [p22^p)(t,.m- 

Remark 6A. Similar consideration apply to the wave equation with Neumann 
boundary conditions. See Remark 8.1 in Chapter 1 of Part IV. □ 

Remark 6.2. For a situation in which there exist periodic nontrivial solutions 
(see G. Da Prato [6]). □ 


6.3 Strongly damped wave equation 

Let LI be an open bounded set of R n with regular boundary 90. Consider the 
equation 


e) 2 x 3x 

—x{t,o = Mt,o + pAz Tt (t,o 

< +(Bu(t, •))(£) in ]0, T\ x O, ( 6 _ 4 ) 

x(t,£) = 0 on ]0,T] x 90, 

=a:o(0> ^(0,0= M0 in ^ 

where v is the outward normal to 90 and p is a given positive number. 

As in §8.2 of Chapter 1 of Part IV, we choose the spaces H, Y, U as 
in (8.3), the scalar product in U as in (8.4), and consider the positive self- 
adjoint operator A defined by (8.5). As O is bounded there exists a complete 
orthonormal system in L 2 (0), {e*,}, and a sequence of real numbers 

0 < Hi < P2 < M2 < • • • — 1 ► +00 


such that 


Ae& — Pk^k: k — 1 , 2 ,.... 


Define the linear operator A\ on E[ 
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A ± X = 


0 1 
—A -pA 


VX e D(A 1 ), 


(6.5) 


D(A!) = H 2 (fl) n H£(Sl) © 

It is an easy exercise to prove that the spectrum of A\ is given by 

er(Ai) = {-1 jp) U | - \{ap, k ± y 1 ( p 2 p 2 k - 4/i fc ): k = 1, 2,... j 


and the resolvent by 
R{\A 1 ) = 


A + pA 1 
—A A 


[\ 2 + pA\ + A]- 1 , VA € cr(Ai). 


From the above formula, it is not difficult to prove that A\ is the infinitesimal 
generator of an analytic semigroup in H . 

Now set 


Bu = 


0 

u 


u G U. 


Condition (ii) of Proposition 3.3 (Hautus condition) is fulfilled because A± only 
has a spectrum with strictly negative real parts, so that (Ai,B) is stabilizable 
with respect to the observation I. 

We can now consider the cost functional (6.3) and solve the corresponding 
minimization problem. 


Remark 6.3. The strongly damped wave equation with time-dependent peri¬ 
odic coefficients has been studied in G. Da Prato and A. Lunardi [1], □ 



2 


Unbounded Control Operators: Parabolic 
Equations With Control on the Boundary 


1 Introduction and setting of the problem 

As in Chapter 2 of Part IV we consider a dynamical system governed by the 
following equation: 

x'(t) — Ax(t) + (Ao — A)Du(t), t > 0, 
x(0) = x 0 , 

or equivalently 

x(t) = e tA xn + (Ao — A) I Du(s) ds, ( 1 . 1 ) 

J o 

where Xq G H and u G L 2 (0, oo; U). We assume that 

A generates an analytic semigroup e tA of type ujq 
and Ao is a real number in p(A) such that ojq < Ao, 

3a e ]0,1[ such that D € C(U\D{[\ 0 — A]“)), 

C € C(H; Y). 

Clearly, if hypotheses (H'P) 00 hold, then the hypotheses (HV) of Chapter 2 
of Part IV are fulfilled with Po = 0. If a < 1/2, we will choose once and for 
all a number f3 belonging to ] 1 — a/2,1 — a/2[. We want to minimize the cost 
function: 

/»00 

Joo{u)= {|Ca:(s)| 2 + |u(s)| 2 } ds (1.2) 

Jo 

over all controls u € L 2 (0, oo; U) subject to the differential equation constraint 
(1.1). We say that the control u € L 2 (0,oo\U) is admissible if Joo(u) < oo. 
The definitions of optimal control, optimal state, and optimal pair are the 
same as in Chapter 1. When, for any Xq G H , an admissible control exists, we 
say that (A, AD) is C-stabilizable. 


(i) 


(HV) o 


(ii) 

(iii) 
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In this chapter, we want to generalize the results of Chapter 1. Several 
of these generalizations are straightforward and the corresponding proofs will 
only be sketched. We will start by proving the existence of a minimal solution 
P^in °f the algebraic Riccati equation 

+ XA - Y*EE*Y + C*C = 0, 

i (1.3) 

Y = [Ao — A*y- a X, 

where E = (Ao — A) a D , under the hypothesis that (A, AD) is C-stabilizable. 
We remark that in order that (1.3) be meaningful, we need a regularity prop¬ 
erty of X, namely 

x e e + (h) n c[H]D{\\q — A*] 1_Q )). 

We shall set = [Ao — The above requirement will make the 

proof of existence much more involved than in Chapter 1 (see §2 below). Once 
the existence is proved, one can show, quite easily (see §3), that the optimal 
control u* exists and is given by the feedback formula 

«*(*) = -£*0‘W, 

where x* is the solution to the closed loop equation 

x(t) = e tA x 0 + [ [Ao - da. (1.4) 

Jo 

Another new difficulty arises in the study of the closed loop operator F 
(see §3), formally defined by 


F = A-EE*V™ n . 

In §3 we prove a characterization of F that enables us to generalize all results 
concerning detectability and Hautus conditions of Chapter 1. Also we leave 
the reader to extend all results on the qualitative behavior of the solutions of 
Riccati equations proved in Chapter 1 . 


2 The algebraic Riccati equation 


We assume here that the assumptions ('HV) 00 are verified and consider system 
(1.1) and the Riccati equation 

P' = A*P + PA-V*EE*V + C*C, (2.1) 


along with the algebraic equation (1.3). We say that 


Pe 


Cs,c« ([0, oo[; E + (H )), if a >1/2, 
C a , a ,p([0,oo[;S+(H)), if a <1/2 
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is a mild solution of (2.1), if 

P(t)x = e tA *P{0)e tA x + f e (t - s)A *C*Ce {t - s)A xds 

Jo 

+ [ e ( - t - s)At V*{s)EE*V{s)e (t - s)A xds. (2.2) 
Jo 

Moreover, X is said to be a solution of (1.3) if 

(i) X G E+(H) n C(H-D([ Ao - A*] 1_ “)), 

(ii) (Xx, Ay) + (Ax, Xy) — ( E*Yx , E*Yy) + (Cx, Cy) = 0 

for all x,y G D(A), where Y = [Ao — A*] 1 ~ a X. 

As in the previous chapter, we shall denote by P m ; n the minimal nonnega¬ 
tive solution of Riccati equation (2.1); that is, the solution of (2.1) such that 
P(0) = 0 (see Propositions 2.3 and 2.4 of Chapter 2 of Part IV). 

We start by proving existence in the easier case a > 1/2. 

Proposition 2.1. Assume ('HV) 00 with a > 1/2 and that (A, AD) is C- 
stabilizable. Then there exists 

P“ n G E+(H) n C(H- D([ Ao - A*] 1- ")) 

such that 

(i) for each x G H the following limit exists: 

lim P m in(t)x = P^ in x, (2.3) 

t—>00 

(ii) P/5 n G S+(H) n C(H- D([ Ao - A*]!-«)), 

(iii) P£f in is a solution of (1.3). 

Proof. As (A, AD) is C-stabilizable, we can prove, by repeating the proof of 
Proposition 1.2.3, that there exists K > 0 such that 

||Pmi„(*)|| < #, t> 0. (2.4) 

Now, arguing as we did in the proof of Proposition 2.2 in Chapter 1, we see 
that there exists P^ n such that (2.3) holds true. Let Q and Q n , n = 0,1,..., 
be the mild solutions (granted by Theorem 2.1 in Chapter 2 of Part IV of the 
Riccati equations 


Q' = + QA - V£EE*V q + C*C, 

Q{ 0) = 


and 


Qn — A*Q n + Q n A — V$ tn EE*V Q>n + C*C, 
Qn( 0) = Pmin(n), 


( 2 . 6 ) 
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where Vq = [Ao — A *] 1 a Q and Vq„ = [Ao — A*] 1 a Q n . We clearly have 

Qn(t) = P m \Jt + n), t> 0. 

Moreover, by Proposition 2.2 in Chapter 2 of Part IV, because 
Q n (0)xQ(0)x, Vx £ H, 


we have 

Q(t)x = lim Q n {t)x = lim P min (f + n)x = Pf f„ x, Vt > 0, x £ H. 

n—> oo n —>-oo 

Thus Q(t) is constant and coincides with P r ff n . As, by Theorem 2.1 in Chap¬ 
ter 2 of Part IV, Q £ C SiQ ([0,oo[ we see that (ii) holds true. 

Finally, (iii) follows from Proposition 2.1 in Chapter 2 of Part IV, because if 
x, y £ D(A ), we have 

® = j t {Q(t)x, y) = (P™ in x, Ay) + (P™ n Ax, y) + {Cx, Cy)-(E*V^ in x, E*V™ in y). 

The proof is complete. □ 

Next, we consider the case a < 1. We first recall that, by Theorem 2.2 in 
Chapter 2 of Part IV, for any x £ Z?([Ao — A\&) we have P m in(t)[Ao — A\@x £ 
D([Ao — A*]P), and the linear operator [Ao — A*]^P min (t)[Xo — A]@ is closable. 
We denote by (Pmin^))^ its closure. 

Proposition 2 . 2 . Assume ('HV) 00 with a < 1 and that {A, AD) is C- 
stabilizable. Then there exists 

P“ n e E+(H) n C(H- D([ Ao - A*] 1 - 0 )) 

such that for all x £ H 

(i) the limits 

lim P m in(t)x = P™ in x, Vx £ H, (2.7) 

t—>oo 

lim (P mi „(t)) „x = R™ in x, Vx £ H, (2.8) 

t—> OO P 

exist, where P“ in = (P ^ n )/3 and 

(P^inb = closure of [A 0 - Ahf P“ n [A 0 - A*] 0 , 

(ii) P“ n £ E+{H) n C{H- D{{ Ao - A*] 1_a )), 

(iii) P^ n is a solution of (1.3). 

Proof. By proceeding as in the proof of Proposition 2.1, we can prove (2.7) 
and that there exists a constant L\ such that 
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||(^nun(t))J <£l, *>0. (2.9) 

We follows here an argument of F. Flandoli [7]; as the proof of (2.9) is easier 
for Ao < 0, we introduce a shifting L = A — X 0 I of A. Clearly L is of negative 
type and, as easily checked, P(t) = P m in(i) is the solution to Riccati equation 


P' = L*P + PL + A 2 - V*EE*V, 

P( 0) = 0 , 


( 2 . 10 ) 


where 

A 2 = C*C + (2A 0 + 2 )P. 

Now, if x G D([Ao — A\&) = D([I — L\P), we have 
(P(t)( Ao - Afx, (Ao - Afx) = ( P(t)(I - Lfx, (/ - Lfx) 

< [ \A(I - Lfe (t ~ s)L x\ 2 ds 
Jo 

poo 

< L 2 [\\c\\ 2 + 2A'(Ao + l] / e~ x ° s s~ 20 ds \x\ 2 , 

Jo 

which implies (2.9). As the family { (Pmin(t))^ } is bounded and nondecreasing 
in /?, ( 2 . 8 ) follows. 

We now prove (ii). Let Q and Q n be the mild solutions (established in 
Theorem 2.2 in Chapter 2 of Part IV of the Riccati equations (2.5) and (2.6)). 
We clearly have 

Qn{t) = Pmin(t + n), t > 0. 

Moreover, by Proposition 2.2 in Chapter 2 of Part IV, because Q n (Q)x —> 
Q(0)x, \/x G H, we have 

Q(t) = lim Q n (t)x 

n —»oo 

= lim P m in(t + n)x = Vf > 0, x G H. 

n —»oo 

Thus Q(t) is constant and coincides with P£? n - As, by Theorem 2.2, in Chap¬ 
ter 2 of Part IV, Q G C s>a)( g([0, oo[ ; A + (7L)), we see that (ii) holds true. 
Finally, the proof of (iii) is similar to that of the previous proposition. So it 
will be omitted. The proof is complete. □ 


3 Dynamic programming 

3.1 Existence and uniqueness of the optimal control 

In this section, we consider the control problem ( 1 . 1 )—( 1 . 2 ). We assume (JHP)oo 
and that (A, AD) is C-stabilizable, and denote by 
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P“ n G S + (H) n C(H; D ([Ao - A*] 1 ” 0 )) 
the minimal solution of the algebraic equation (1.3) and we set V£? n = [Ao — 

j*ll —a poo 

J ^inin' 

We first recall that, in virtue of (3.1) in Chapter 1, we have 

(Pmin(t)x 0 ,X 0 ) + [ \ll(s) + E*V min (t - S)x(s)\ 2 ds 
Jo 

{|(7a;(s)| 2 + |w(s)| 2 }ds, (3.1) 

for any Xq G H and any u G L 2 (0, oo; U), where x is the solution of (1.1). Now 
we study the closed loop equation (1.4) which is meaningful because P^ in G 
E + {H) n C(H;D([X 0 - A*] 1-Q )) and || [A 0 - A] 1 " 0 ^-* 0 ) || < L{t - s)"" 1 . 

Proposition 3.1. There exists a unique solution x G C([0, oo[ ; H) of (1.4). 

Proof. For any x G C([0, oo[; H) we set 

(A(y))(i) = /'[Ao - Af-^-^EE+V^x^ds, 

Jo 

for all t G [0,T]. Then we have 

||(A(y))(t)|| <L 2 ||y^ n || fit-sr-'daWvWcmYM 
Jo 

< 2^ill^ll* a ||yllc([0, t ];/0» 

so that A G £(C([0, i]; IT)) for any t G ]0, T] and 

l|A|U(C([0,t];H)) < 9 q, _ 1 H^iSnll ^ • 

Thus, if t is small, A is a contraction and (1.4) has a unique solution in 
C([0,t];H). Now this argument can be repeated in the interval [t,2t] and so 
on, giving the conclusion. □ 

We prove now the main result of this section. 

Theorem 3.1. Assume that assumption ( TLV)oo Is verified and that {A, B) is 
C-stabilizable. Then there exists a unique optimal pair (■ u*,x *) for the optimal 
control problem (1.1)-(1.2). Moreover the following statements hold: 

(i) x* G C([0, oo[; H) is the mild solution to the closed loop equation (1.4). 

(ii) u* G C([0, oo[; U) is given by the feedback formula 

«*(*) = (3.2) 

where represents the minimal solution of the algebraic Riccati equa¬ 
tion (1.3). 
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(iii) the optimal cost Joo(u*) is given by 

Jo O (u*) = (P™ in x 0 ,x 0 ). (3.3) 

Proof. In view of Proposition 3.1, the proof is similar to that of Theorem 3.1 
in Chapter 1. So it will be omitted. □ 

3.2 Feedback operator and detectability 

Assume that the hypotheses of Theorem 3.1 hold and let ( u*,x *) be the 
optimal pair for problem (1.1)—(1.2). We want here to construct, following 
G. Da Prato and A. Ichikawa [1], a closed loop operator F for the system 
(3.1); that is a linear operator, infinitesimal generator of a strongly continuous 
semigroup e tF , such that 


x*(t) = e tF Xo , t > 0. (3.4) 

Proposition 3.2. Assume (HP oo) and that (A,B) is C-stabilizable. For any 
xo £ H set 

S(t)x = x*(t), 

where x*(t) is the optimal state corresponding to Xq■ Then S(-) is an analytic 
semigroup in H and its infinitesimal generator F is given by 

Fx = (A 0 - A)(AR(\o, A)x + DE*V™ in x), 

D(F) = {x£H: AR{\ q ,A)x + DE*V™ in x £ D{A)}. ’ 

Finally, if the resolvent of A is compact, so is the resolvent of F. 

Proof. We first remark that for any Xq £ H, x(t) = S(t)x o is precisely 
the solution of the closed loop equation (1.4). Thus, x is continuous, by 
Proposition 3.1, and S(t) is a strongly continuous semigroup in H. Let 
F: D(F) £ H —> H be its infinitesimal generator; we want to prove that 
F is given by (3.5). To this aim, let xo £ D(F), x(t) = S(t)x o- We have 

R(Xo,A)x(t) = e tA R( A 0 , A)x 0 + [ e (i - s)A DET m ”i(s) da. 

Jo 

As x(t) is continuously differentiable, we have 

R( A 0 , A)x'(t) = AR(Xo, A)x(t) + DE*V^ n x(t). 

Setting t = 0, it follows that 

R{ Xo, A)Fx o = AR{\ 0 ,A)xq + DE*Oo, (3.6) 

so AR(Xq, A)xq + DE*V^ n xo £ D(A) and 
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Fx o = (A 0 - A){AR(X 0 ,A)x 0 + DE*V£ n x 0 ). (3.7) 

Conversely assume that 

AR{ A 0 , A)x o + DE*V™ n x 0 G D(A). (3.8) 

Then, by (3.6) and the density of D(F), the linear operator R(Xq,A)F is 
closable and its closure N = R(Xq,A)F is bounded. Now, if (3.8) holds, we 
have Nxo G D{A) and it is not difficult to show that this implies Xo G D(F ) 
and (Ao — A)Nxq = Fx q. 

It remains to show that e tF is an analytic semigroup. Let 
Sujo = {A G C: | arg(A - w)| < 6» 0 } 
be a sector contained in the resolvent set p(A) and assume that 

||*(AM)||< "W A GS Ul#0 , (3-9) 

|A - U )| 

for some constants to and M(9) = M{—9) (see §2.7 of Chapter 1 of Part II). 
Let A G Scj^ 0 , i) G H\ consider the equation A£ — Ft; = r), which is equivalent 
to 

AC - [Ao - A]{AR( Ao, A)£ + DE*V£J} = t). (3.10) 

Multiplying (3.10) by R(X,A ), gives 

C - [Ao - A\ 1 -°‘R(X, A)EE*V™ in $ = R( A, A) v . (3.11) 

As [Ao — A] a D is bounded and || [Ao — A] 1_ “i?(A, A)|| < const. |A|““, there 
exists p > 0 such that, for any A G {p G S Ut e 0 : \p\ > P }, (3-11) has a unique 
solution C = R( A, F)ii, where 

R( A, F) = {/•- [Ao - A] 1_a i?(A, A)([A 0 - A] Q D)I?^y“ n }- 1 i?(A, A). (3.12) 

From (3.9) and (3.12) it follows that the semigroup generated by F is analytic 
and that if R( A, A) is compact so is i?(A, F). □ 

The operator F is said to be the closed loop operator for the optimal 
control problem (1.1)—(1.2). Remark that, by (3.3), we know that the function 
Cx*(t) = Ce tF x o belongs to L 2 (0,oo;i7). Thus, when C = I (or if C -1 G 
C(F[)), by Datko’s Theorem, it follows that F is exponentially stable. Thus, 
in this case, (A,B) is feedback stabilizable. 

We give now a generalization of Proposition 3.4 of Chapter 1. 

Proposition 3.3. Assume that ( A , C) is detectable. Then F is exponentially 
stable. 

Proof. Let Xo G H, and let (u*,x*) be the optimal pair corresponding to xq. 
By Remark 3.2 in Chapter 1, there exists K G C(Y ; H) such that A — KC is 
exponentially stable. Now it is easy to check that 
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x*(t) = e^ A ~ KC) x 0 + f \\ 0 - A)e {t - s ^ A ~ KC) Du(s) ds 

Jo 

+ [ e {t - s)(A ~ KC) KCx{s)ds. 

Jo 

As Cx *, u* £ L 2 ( 0, oo; U) and A — KC is exponentially stable it follows that 
x* £ L 2 ( 0, oo; H). Datko’s Theorem yields the conclusion. □ 


3.3 Stabilizability and stability of F in the point spectrum case 


We consider here the system (1.1) under hypothesis (HP oo) and we assume 
that A verifies the point spectrum hypotheses (V) (see §3.2 in Chapter 1). We 
want to give a necessary and sufficient condition in order that (A, AD) be 
stabilizable with respect to the identity I. We need a lemma whose proof is 
similar to that of Lemma 3.1 (Chapter 1). 

Lemma 3.1. Assume (TtV oo) and (V) with cr 0 (A) = 0. Then the following 
statements are equivalent: 

(i) For all x £ H, there exists u £ L 2 (0, oo;U) such that the solution x of 
(1.1) belongs to L 2 (0,oo; H). 

(ii) The mapping 


pOO 

ju = (Ao — A) / e~ aA Il\Du(s) ds: L 2 (0, oo; U) —> H 
Jo 


is onto. 

(iii) The mapping 


7*: H -> L 2 {0,oo;U), 

(7*000 = D*{\ o - A*](77+)*e- sA *C, ? € H 

is one-to-one. 

(iv) Ker (£>*(A - A*)) D Ker(A - A*) = {0}, for all A e cr+(A*). 

Proof. It is completely similar to the proof of Lemma 3.1 in Chapter 1. □ 

We now generalize Propositions 3.3, 3.4, and 3.5 of Chapter 1. 


Proposition 3.4. Assume ('H'P) 00 and (fP). Then the following statements 
are equivalent: 

(i) ( A , AD) is stabilizable with respect to I. 

(ii) For any A £ a°(A*) U a + (A*), 


Ker (£>*(A - A*) n Ker(A - A*)) = {0}. 


Proposition 3.5. Assume that (A, AD) is C-stabilizable and that A and F 
fulfill (V). Then the following statements are equivalent: 
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(i) F is exponentially stable. 

(ii) For any A € <J + (A) U o°(A), we have 

Ker(A - A) 0 Ker(C) = {0}. (3.13) 

Proposition 3.6. Assume that the hypotheses of Proposition 3.5 hold. Then 
the following statements are equivalent: 

(i) F is exponentially stable. 

(ii) ( A , C) is detectable. 

Example 3.1. Let fl be an open bounded set of R" with regular boundary 90. 
Consider the state equation 

( = + c)a;(f,0 in ]0 ,T[ x 0, 

| x(t,£) = u(t,£) on]0,T[x9O, (3-14) 

U(0,£) = a’ 0 (£) in 0, 


where c > 0, Xq € L 2 (0), and u € L 2 (90). We choose H = Y = L 2 (fl) as 
space of states and observations and U = L 2 (90) as space of controls. We 
denote by A the linear self-adjoint operator in H: 

j Ax = Acx + cx, \/x G D(A), 

|d(A) = H 2 (fl) n.ff<J(fi). 

We consider the following problem: To minimize 

/•OO f /»00 f 

J(u)= / \x(t.,0\ 2 dtdf + / / \u(t,£)\ 2 dtdf. 

J 0 J Q, JO J dQ 

Let D : L 2 (dD) —> L 2 (0) the Dirichlet mapping introduced in Example 1.1 of 
Chapter 2 in Part IV; then problem (3.14) can be written as 

x(t) = e tA xo + (cl — A) I"' ed~ s ' ,A Du(s) ds, 

Jo 

and hypotheses (TCP oo) hold with Ao = c. We denote by {^a-} a complete set 
of eigenvectors of A and by {—Afc} the corresponding sequence of eigenvalues. 
We assume that {A^} is a nondecreasing sequence and that 

0 < Ai < c, A k > c, k = 2,3,..., 


and we prove that (A, AD) is stabilizable. Recalling Proposition 3.4 it is 
enough to observe that 


D*(A*-c)tp r 


chpi 

do 


is not identically zero; this in fact is a consequence of a result that can be 
found in E. J. P. G. Schmidt and N. Weck [1], □ 
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Remark 3.1. Stabilizability for parabolic boundary control problems was stud¬ 
ied by several authors, see T. Nanbu [1], I. Lasiecka and R. Triggiani [4, 
5], and H. Amann [1]. 

These results have been generalized by A. Lunardi [2, 4] for non- 
autonomous state equations with periodic coefficients (see also P. K. Med¬ 
ina [1]). □ 




3 


Unbounded Control Operators: Hyperbolic 
Equations With Control on the Boundary 


1 Introduction and setting of the problem 


We use here the notation of Chapter 3 in Part IV. We assume that 

(i) A generates a strongly continuous group e tA in H 
of type w o and Ao is a real number in p(A) such 
that wq < Aq, 


(HH) oo < 


(ii) 

(iii) 


l(iv) 


E G £(U;H), 

VT > 0, 3Kt > 0 such that 


\E*A* 


-sA* 


J 0 

C <=£(H;Y). 


x\ 2 ds < Kt\x\ 2 , 


Vx G D(A*), 


> 0 , 


Clearly, if ( 'KK) 00 hold, then the hypotheses (HH) of Chapter 3 in Part IV 
are fulfilled with Pq = 0. We want to minimize the cost function: 


/•OO 

Joo(u)= {|Ca;(s)| 2 + |w(s)| 2 }ds, 
Jo 


over all controls u G L 2 (0, oo; U) subject to the equation constraint 


x(t) = e xo + G(u)(s), 

G(u)(s) = (Ao — A) f e ( ' t ~ s ^ A Eu(s)ds. 

Jo 


( 1 . 1 ) 


( 1 . 2 ) 


Moreover, xo G H and u G L 2 ( 0, oo; XJ). We recall that by Proposition 3.1 in 
Chapter 1 in Part II, x G C([0,T];17) for all G L 2 (0,T; [/); more precisely 

Gg £(L 2 (0,T; U)-,C([0,T\ ;H)), VT > 0. 

We say that the control u G T 2 (0, oo; XJ) is admissible if Joo(m) < oo. The 
definitions of optimal control, optimal state, and optimal pair are the same 
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as in Chapters 1 and 2. When, for any Xq €E H, an admissible control exists, 
we say that (A, AE) is C-stabilizable. 

In order to solve the control problem (1.1)—(1.2), we consider the opti¬ 
mization problems: to minimize 


Jt(u)= ( {\Cx(s)\ 2 + \u(s)\ 2 }ds, (1.3) 

Jo 

over all controls u € L 2 (0,t; U) subject to the equation constraint (1.1), and 
denote by («£,: xf) the corresponding optimal pair, then we prove the conver¬ 
gence of (Uf,Xt) to an optimal pair for the problem (1.1)—(1.2). 

For a different approach to the study of the algebraic Riccati equation and 
more results, see the paper by F. Flandoli, I. Lasiecka, and R. Trig- 
giani [1], and the Lecture Notes by I. Lasiecka and R. Triggiani [11]. 
The situation where assumption (7i7-f) 00 -(iii) is not fulfilled is considered in 
I. Lasiecka and R. Triggiani [12], where specific examples are provided. 


2 Main results 

The main result of this chapter is as follows. 

Theorem 2.1. Assume (HH)^ and that (A, AE) is C-stabilizable. Let(u*,Xf ) 
be the optimal pair corresponding to problem (1.2) —(1.3)/ then there exist 
u* € L 2 ( 0, oo; U) and x* € L 2 (0, oo; H) such that 

(i) Hindoo uf = it* in L 2 (0,T;U), for all T > 0. 

(ii) Hindoo xf = x* in L 2 (0,T; H), for all T > 0. 

(iii) (u*,x*) is an optimal pair for the problem (1.1) —(1.2). 

Proof. Denote by P m in(-) the mild solution to (1.5) of Part IV, Chapter 3, 

with P 0 = 0. Let xq € H, u € L 2 (0,oo;U) and let x be the corresponding 

solution to (1.1); we have 

( Pmin ( t ) x 0 , x 0 ) < f {|Ca;(s)| 2 + |u(s)| 2 }ds 
Jo 

<Joo(u), Vw € L 2 (0, oo ; U). (2.1) 

As (A,AE) is C-stabilizable, there exists M(x o) > 0 such that 
(P m in{t)x 0 , X 0 ) < M(x 0 ), vt > 0. 

By the Uniform Boundedness Theorem, it follows that there exists M > 0 
such that 

||Pmin(t)|| <M, Vt> 0. (2.2) 


Then there exists the limit 
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-^min‘^'0 — lim Pmin(t)xo> 'Jxq € H. 

t —> oo 

From (2.1) it follows that 

(P£ n xo,xo) < Joo(u), Vu G L 2 (0, oo;17). (2.3) 

On the other hand we have 

(PminW^O^o) = / {|C^( S )| 2 + K( S )| 2 }d S , Vi>0, (2.4) 

Jo 

and taking into account (2.2), we see easily that the set {ilt}t>o> where 


Ut(s) 


u* t (s), if s G [0, t], 
0, if s > t, 


is bounded in L 2 (0, oo; U). Thus there exists a sequence t n | oo and a function 
u G T 2 (0, oo; XJ) such that 

ut n — 1 u, in L 2 ( 0, oo; XJ) as n —> oo. (2-5) 


x (t) = e tA xo + G(u)(t). 

Fix now T > 0. Obviously 

ul u, in X 2 (0, T; U) as n —> oo, 

and consequently, 

x\ n — x, in i 2 (0, T; U) as n — > oo. 

From (2.4) it follows that 

{Pmin x 0,x 0 )> I {|£(s)| 2 + |u(s)| 2 }ds, Vt > 0. 

Jo 

As T is arbitrary we can conclude that Cx G L 2 (0, oo; H) and 

(PminX0,X 0 ) > Joo(u), (2.6) 


which, along with (2.3), implies that the pair (u,x) is optimal. It remains to 
prove (i) and (ii). We first remark that, by the Lebesgue dominated conver¬ 
gence theorem 

Cxi ^ x, in L 2 (0, T; oo) as n —> oo. 

Letting n tend to infinity in the equality 
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we find 

/»oo 

lim / {\Cx* T n (s)| 2 + |wr(s)| 2 }ds = (P™ in x 0 ,x 0 ). 

Jo 

This implies that the convergences of {u^(s)} to u and of {(Ar^s)} to Cx 
are strong. As the optimal pair is unique, by the strict convexity of the cost 
Joo, (i) and (ii) follows. □ 


Example 2.1. We consider here the system described in Example 4.3 of Chap¬ 
ter 3 of Part IV, but with T = +oo. In order to apply Theorem 2.1 it is enough 
to check that (A, AE) is exactly controllable. As remarked at the end of §2 in 
Chapter 2 of Part II, the relevant estimate to prove is that, for T sufficiently 
large, there exists a constant C(T) > 0 such that 



dv 

dv 


2 

L 2 (d fi) 


dt > C(T)E{ 0), 


where v is the solution to the problem 


(2.7) 


I u(i,£) =0, t > 0, £ e dQ, 

\v(0,^ = v 0 eH^n), 

U(0,0 =v 1 eL 2 (n), 

and 

E(t) = ^ J [\V v (t,£)\ 2 + \ v t(t, 0 | 2 ] dt. 

To prove (2.7) we follows J. L. Lions [4]. We introduce the following notation: 
X(t) = (v t ,£- Vw), Y(t) = (v t ,v), 

where (•,•) denotes the scalar product and | • | the norm in L 2 (fl). We first 
prove the identity 


Y(T) — F(0) = f K 2 -|Vw| 2 ]dtdt. (2.9) 

dnx[o,T] 

In fact, multiplying both sides of the first equation in (2.8) by v and taking 
into account that 

(' v 2 )tt = 2 v\ + 2 vv tt , 

we find 

vv tt = \{v 2 )tt ~ v\ = vAv. 

Integrating on f l 

\ [ (v 2 ) u d£- [ v 2 d£ = [ vAvd£=- [ \Vv\ 2 d£, 

" Jo Jo J 02 J a 
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and so 

which implies (2.9). 

Now we multiply both sides of the first equation in (2.8) by £ • Vv and 
integrate in 12 x [0,T]. We find 


I=J, 


where 


and 


1= / (f-Vv)v tt dfdt 

dOx[0,T] 


J = 


/Qx[0,T] 


(£ • Vv)Av df dt. 


We proceed now in three steps. 


Step 1. Estimate of I. 

By integrating by parts successively in t and in f, we find 


I = X(T)-X{ 0)- f {f-Vvt)v t dfdt 

JSix [0,T] 

= X(T) - X(0) - \ [ f-V(v 2 )dfdt 
z dn x [o,T] 

= X(T) - X(0) + £ f vfdfdt. 

z dnxio.Ti 


Step 2. Estimate of J. 

By integrating by parts in £, we find 


J = E 


. dv d 2 v , 
^ -^72 ^ dt 


/“l Jnx [ 0 > T ] 

dv dv 


= E 






^ 1 Jaox[o,T] dxh d£k 


da dt — 


h.A; 


^ «/nx[0,T] V 9 W 


& 


dz> \ dv 


df dt 


/anx[o,T] 


(€ ■ Vv) 


dv 

dv 


da dt- - Y 


j 

Jn 


in — 

h ~ i^x[°,r] df k 


dv 


df h 


df dt 


fix[0,T] 


|Vv| 2 df dt. 


We observe now that, as v = 0 on 912, we have Vv = It follows that 
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J = [ (£ • V«) 

JdQx[0,T] 


dv 

dv 


da dt — 


£ • V(|Vu| 2 ) dxdt 


/Ox[0,T] 

|Vu| 2 d£ dt 


/!)x[0,T] 


4anx[0,T] 

Step 3. Conclusion. 
As I = J, we find 


(Z-v) 


dv 

dv 


dcr dt + [ — — 1 


/Qx[0,T] 


|Vw | 2 d(dt. 


'd£lx[0 ,T] 


(£■ 


Szc 


dcr 


= X(T)-X(0) + ^J 


Ox[0,T] 

= X{T)-X(0) + ^ f [v?-\Vv\ 2 ]d£dt+ [ \Vv\ 2 d^dt. 
2 dox[0,T] dnx[0,T] 


^ dt - ( - - 1 


/f2x[0,T] 


| V | 2 dx dt 


In conclusion 


/dfix[0,T] 


(t-v) 


dv 

dv 


da dt 


i: I 

a +-y 


TE{ 0). 


J o 


Now, let R > 0 such that O is included in the ball B(0,R) and let op > 0 
such that |u| < ao|Vu|; then 


\X\ < R\v t \ |Vw| < RE( 0) 


and 

and so 


\Y\ < \v\ \v t \ < a 0 \v t \ |Vu| < a o A(0), 


/aox[o,T] 


(Z-v) 


dv 

dv 


da dt > E(0)[T — 2 R — 3ao], 


and the required estimate (2.7) holds for T large. 


□ 


3 Some result for general semigroups 

In this section we do not assume that A generates a strongly continuous group 
but 
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Woo { 


(« 

(ii) 

(ill) 


l(iv) 


A generates a strongly continuous semigroup e tA 
in H of type < Ao, for some real number Ao, 

E G C(U ; H), 

VT > 0, 3 Kt > 0 such that 


| E*A* 


„sA* 


J 0 

C <=£(H;Y). 


x\ 2 ds < Kt\x\ 2 , 


Vx G D(A*),t > 0, 


By the results of §5 in Chapter 3 of Part IV, we are able to show the existence 
of an optimal pair (u^,x1 ) of the control problem (1.2)-(1.3) under hypotheses 
{'H'HYoo- Then the following theorem is proved as Theorem 2.1. 

Theorem 3.1. Assume andthat(A, AE) isC-stabilizable. Let (w£, x%) 

be the optimal pair corresponding to problem (1.2)-(1.3). Then there exist 
u* G L 2 ( 0, oo; U) and x* G L 2 ( 0, oo; H) such that 

(i) lim^oo uf = u * in L 2 (0,T;[7), for all T > 0. 

(ii) Hindoo x( = x* in L 2 (0, T; H), for all T > 0. 

(iii) (u*,x*) is an optimal pair for the problem (1.1) —(1.2). 

Example 3.1 (Age-dependent equations). We continue here Example 5.1 of 
Chapter 3 of Part IV, but taking T = +oo. In order to apply Theorem 2.2 we 
have only to check stabilizability. Set 


<Ji{A) = {A G a(A): Re A < 0}, 
a 2 (A) = {X G <j(A): ReA>0}, 

and denote by Q i and Q 2 the spectral projectors on ai(A) and 02 (A), re¬ 
spectively. As is well known Q 2 is a finite dimensional projector; moreover, 
because the semigroup S(-) is differentiable for t > a+ the spectral determin¬ 
ing condition holds true, and there exist M > 0 and r > 0 such that 

||S(i)Qi|| < Me~ rt , t> 0. (3.1) 

We set pi(t) = Qip(t), t > 0 and P 2 (t) = Q 2 P(t), t > 0 and denote by 
A\ and A 2 the restrictions of A to Qi{H) and Q 2 (H), respectively. By (3.1) 
it follows easily that p\ G L 2 (0, 00 ; H) for any u G L 2 (0, 00 ). So, we have 
only to check that, for any p 0 G H there exists u G L 2 (0, 00 ) such that 
P 2 G L 2 (0, 00 ; Q 2 (H)). Now p 2 is the solution of the finite dimensional Cauchy 
problem 

jp' 2 (t.) = A 2 p 2 (t) - aA 2 Du(t), 

\P2(0) = Q2P0- 

By a well-known result due to Hautus (see Part I, Chapter 1, §2.6), the system 
(3.2) is stabilizable if and only if 
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Ker(A - A* 2 ) n Ker (D* A* 2 ) = {0}, VA G cr 2 (A). 


(3.3) 


Now we can easily check that the spectrum a(A) of consists of simple 
eigenvalues A that are exactly all the solutions to the equation 


1 = [ + e~ Xb K(b) db. 
Jo 


(3.4) 


If A is an eigenvalue of A, then a corresponding eigenvector is given by 

<p\(a) = e~ Xa Tt (a), a G [0,a+]. (3.5) 

Moreover the adjoint A* of A is given by 


(D(A*)={ipeH\0,a + ): iP(T)=0}, 
A*^ = ip' — ^ip + f3ip( 0). 


(3.6) 


Finally cr(A*) = er(A), and if A G a(A*), then a corresponding eigenvector is 
given by 

ipx{a) = —[ e x ( a ~ b) K(b) db , oG[0,a+]. (3.7) 

?r(a) Ja 

Let now A G ( 72 (A) and ip G Ker(£)*A 2 ); then we have 


1 = f + e~ Xb K(b) db , 
Jo 


to 

and a corresponding eigenvector to A is given by 

r a + 


ip\(a) = —-b- [ e A(a b) I\(b)db , oG[0,a+]. 
na) Ja 


(3.8) 


(3.9) 


It follows, recalling hypotheses (5.8) of Part II, Chapter 3, 


D*A* 2 ip = (ip, tt) = - 


[ + e~ Xb K(b) db - 1 
Jo 


^0. 


Thus (A, AE ) is 7-stabilizable. 


□ 



A 


An Isomorphism Result 


We present two proofs of an isomorphism result that plays a key role in the 
solution of the linear quadratic optimal control problem. Proposition 1.1 gives 
a direct proof, whereas Proposition 1.2 gives a proof based on the variational 
characterization of the minimum of a linear quadratic cost function under a 
linear state equation constraint. This second proof also yields a general result 
on the invertibility of a 2 x 2 matrix of operators, which corresponds to the 
usual optimality system obtained from the coupled system in the state and 
adjoint state variables. In this appendix X represents a Hilbert space, with 
inner product (•, •) and norm | • | and T and S linear bounded operators in X. 

Proposition 1.1. Assume thatT and S are symmetric and nonnegative; then 
I + TS is one-to-one and onto. Moreover 

||S(/ + TS)- 1 || <||S|| 

and 

ii(/+T5)- 1 n <i + imi nsj|. 

Proof. Step 1 . / + TS is one-to-one. Let xq £ X such that xo + TSx o = 0. 
Then we have Sx o + STSxo = 0, and so 

{Sx o, xo) + {TS:T 0 , Sx 0 ) = 0, 

which implies (Sxo,xo) = 0, and consequently Sxo = 0 and finally 0 = 
xo + TSx o = xo- 


Step 2. 

R := (/ + TS)(X) is dense in X. Let yo € X be such that 
((I + TS)x,y 0 ) =0, VxeX. 


Then 

which implies yo 


(x,(I + ST)y 0 ) = 0, Vx e X, 
0 by Step 1 (exchanging T and S). 
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Step 3. 

0 < (S(I + TS)~ 1 x, x) < ( Sx, x), \/x £ R. Let x £ R and let z = (I + TS)~ 1 x. 
We have, recalling that T > 0, S > 0, 

(Sx, x) = ( S(I + TS)z, (I + TS)z) 

= ( Sz, z) + (Sz, TSz) + (STSz, *) + (STSz, TSz) 

> (Sz,«) + (Sz, TSz) = (Sz, (I + TS)z) 

= (S(I + TS)~ 1 x,x) > 0. 

Step 4. 

(S(I + TS)~ 1 x,y) = ( x,S(I + TS)~ 1 y), V x,y £ R. Let x,y £ R and let 
z = (I + TS)~ 1 x, w = (I + TS)~ 1 y. We have 

(S(I + TS)~ 1 x, y) = (Sz, w + TSw) = ((/ + TS)z, Sw ) 

= (x,S(I + TS)- 1 y). 


Step 5. 

Conclusion. By steps 2, 3, and 4 the symmetric operator S(I + TS) -1 has a 
unique extension to a symmetric bounded operator that we denote again by 
S(I + TS)~ 1 . Now for any x £ R we have 

(I + TS)~ 1 x = x- TS(I + TS)~ 1 x\ 

thus, by Step 3 

|(J + TS') _1 a;| < |a;| + ||T|| |5a;|. 

This implies that R is closed; because it is dense by Step 2, it is onto. □ 
The above result was first proved in an early version of this book via an 
optimal control argument. We give it below because this type of result is useful 
in many contexts. 

Consider the real Hilbert spaces U and H, the continuous linear operators 
B£C(U-,H), Q£C(H-H) 

and assume that 

\/x £ H, (Qx, x) > 0, 

Vx, y £ H, (Qx,y) = (Qy,x). 

Define the following optimal control problem: To find u £ U such that 

inf J(u), 

uGU 


where 
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J(u) = \{Qx + 2 q, x ) + \\u\ 2 

and 

x = Bu + / 

for some given pair (/, g) £ H x H. 

This problem has a unique solution u £ U that is completely characterized 
by the following optimality condition: 


where 

and 


d,J{u\ v) =0, Vi> £ U, 
d,J(u\ v) = (Qx + q,y) + (u, v) 


x = Bu + /, y = Bv. 
Introduce the adjoint variable p £ H 


p = Qx + q 


and rewrite the optimality condition 

(p, Bv) + (u, v) = 0| Vv£U => u + B*p = 0. 

Using this characterization we can now write the coupled system in the form 


/ BB* 


X 


7 ' 

-Q I 


P_ 


_q_ 


We conclude that for any given pair (f,q), there exists a pair (x,p) for which 
the above identity is verified. Moreover when f = g = 0, 

x + BB*p = 0 => (x,p) + \B*p\ 2 = 0, 

—Qx + p = 0 => —(Qx,x) + (p,x)= 0 

and x = p = 0. Therefore the matrix of operators is invertible. 

Finally set q = 0 and eliminate p in the first equation of the coupled 
system. Then 

x + BB*Qx = f => [I + BB*Q]x = f. 

Again for any / in H , there exists an x in H for which the above identity is 
verified. For / = 0 

x + BB*Qx = 0 => (Qx,x) + \B*Qx\ 2 = 0 
=4> Q}! 2 x = 0 =4> x = 0. 


Hence I + BB*Q is invertible. 



540 V-A An Isomorphism Result 

Proposition 1.2. Given two real Hilbert spaces U and H and two linear 
bounded operators 

B G C(U, H) 

such that 

\/x G H , 

Vz, y G H, 

then the operators 

I BB* 

-Q I 

are (algebraic and topological) isomorphisms. 

This last proposition was also proved by M. Sorine [1], 

Proposition 1.1 is now obtained with X = H = U,S = Q , and B = T 1 / 2 . 


and Q G C(H, H ) 

(Qx, x) > 0, 

{Qx,y) = ( Qy,x ), 

and [I + BB*Q] 
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